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第 一 版 序 


第 二 版 在 以 下 几 方面 对 第 一 版 作 了 较 太 的 补充 和 修改 ;第 一 ， 
给 出 了 唯一 性 准则 的 简洁 证 有 明 ， 第 二 ， 充 实 了 芒 亭 进 界 理论 ， 对 
BREE TS HARRAH, ABH, RST MAP ‘有限 非 保 
TAA RHED O CRNA, BO, WNT BS Ree 
最 小 过 程 ， 以 及 DV 型 和 (DV)* MALE, DVARO 
(DV) RGAE. Ibs, BAW MS. 

本 书 第 一 版 于 1981 年 出 版 后 ,获得 许多 同志 的 热情 关心 .欢迎 
和 鼓励 。 特 别 令 人 激动 的 是 ， 不 少 同志 提出 了 宝贵 的 修改 意见 ， 
对 此 ， 我 深 表 感谢 。 我 还 训 心 感谢 湖 表 科学 术 技 出 版 社 ， 给 本 届 
提供 第 二 版 的 机 会 。 


杨 向 群 
198446455 FHA 


马尔 科 夫 过 程 丰 随机 过 程 中 占有 十 分 重要 前 地 位 。 可 列 马尔 
科 去 过 程 是 马尔 科 夫 过 程 的 一 个 非常 活 紧 而 且 理 论 比 较 完整 的 分 
支 ， 它 在 科学 技术 的 许多 领域 中 都 共有 广泛 的 应 用 。 不 少 著名 的 
MRSS, HN RAB RK CA.H.Konamoropos), HHO, 
L, Dooo), Fea) CW, Feller), FRY, WEWER AAE 
开展 工作 ， 并 作出 了 重要 的 贡献 。 二 十 多 年 米 ， 我 国 的 岷 率 论 工 
作者 对 这 一 领域 进行 了 广泛 深入 的 研究 ， 上 自前 已 有 《 生 灭 过 程 和 
马尔 科 天 链 ?、《 齐 次 可 列 马 尔 可 夫 过 程 ?4 可 道 蕊 尔 可 来 过 程 ? 等 
= Bhs HR. 

1958 年 ， 南 开 大 学 王 梓 坤 教授 开始 发 表 他 在 这 一 领域 的 研 帘 
成 果 , 随 后 他 和 地 的 学 生 以 及 同事 们 深入 并 开 招 了 这 方面 的 工作 ， 
由 于 长 期 不 己 的 努 轧 ， 好 们 在 这 一 学 科 的 几 个 主要 课题 上 都 取得 
了 很 好 的 成 绩 。 本 书 是 杨 铅 群 教授 的 一 部 专 善 ， 总 结 了 他 二 十 年 
来 对 可 列 号 尔 科 夫 过 程 构造 论 的 研究 战果 ， 其 中 有 些 成 采 还 是 首 
KREK. 

WAISRA REY TRAE REM. BAH 
WER ERR PERNA, FRA QER 
造 ,以 及 构造 论 中 的 概率 方法 及 其 与 分 析 方 法 的 联系 等 三 个 方面 ， 
并 在 这 些 方面 取得 了 达到 国际 洛 进 水 平 的 成 果 。 

生 灭 过 程 在 国际 上 有 不 少 人 研究 。 卡 林 CS, Karlin) 等 给 出 
T BME ASSL, wE CW. Feller) 用 分 析 方 法 构造 了 同时 
满足 向 后 和 向 前 方程 组 的 全 部 生 灭 过程 。 王 粹 坤 用 概率 方法 构造 
了 全 部 不 中 断 的 生 灭 过 程 。 杨 辣 群 用 两 种 方法 构造 了 全 部 生 灭 过 


+ J +» 


程 并 如 致 地 考察 了 这 些 生 灭 过 程 的 性 质 。 因 些 ， 生 灭 过 程 的 构 道 
问题 得 以 圆满 解 次 ， 

可 列 马尔 科 夫 过 程 的 一 般 构 造 是 十 分 困难 的 问题 。1957 年 费 
勤 在 Q@ 保 字 、 有 限 流 出 、 有 限 流 入 条 件 下 ， 构造 了 满足 器 前 方程 
AWS ROME, ARBRE AH PMT SRO, R 
利 姆 斯 CD, Williams), PIPER ATE 8 保守 、 有 限 流 出 情形 下 
求 出 了 全 部 Q@ 过 程 。 最 近 ， 杨 向 群 对 这 一 问题 又 有 了 新 的 发 展 ， 
他 在 更 广泛 的 条 件 一 一 8 的 非 保 守 状 态 和 流出 边界 都 有 限 一 一 下 
RT SRO HE. 

构造 论 中 的 黄种 方法 ， 即 概率 方法 和 分 析 方 法 ， 各 有 其 优 品 
和 不 足 ， 均 取得 一 定 的 成 果 。 两 种 方法 的 结果 在 有 形 式 上 相差 很 
远 。 轧 向 群 就 生 灭 过 程 找到 了 这 两 种 方法 的 联系 ， 把 这 两 种 不 同 
RAE RA ER., BERR ET ARR DA A PR. ME 
PER Sg UE RE, Pa L 
作 还 有 待 深 入 ， 它 是 一 个 发 展 前 途 广阔 的 领域 。 

本 书 不 是 作者 成 果 的 简单 汇编 ， 而 是 经 过 精心 整理 和 编排 的 
一 本 著作 ， 我 想 ， 读 者 在 阅读 了 王 梯 地 的 专著 《 生 严 过 程 和 马尔 


科 夫 链 * 第 一 、 二 、 三 章 后 ， 就 可 以 比较 顺利 地 阅读 完 本 书 而 过 
到 这 一 领域 的 研究 前 治 。 因 此 ， 本 书 的 出 版 一 定 会 对 我 国 概率 论 
的 发 展 起 促进 信用. 


在 本 书 出 版 之 际 ， 我 略 抒 所 见 ， 为 学 识 所 限 ， 不 免 有 不 妥 之 
处 ， 请 同志 们 批评 指正 。 | 


RR 
1980 年 3 月 于 长 沙 猎 道学 院 
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ASS FR HE ETE TT FU ARB DE EG Ty ERR 
总 结 。 第 一 章 介 绍 构造 论 的 分 析 基 础 ， 然 后 逐步 进入 专题 

梅 造 论 是 马尔 科 夫 过 程 理 论 中 一 个 核心 课题 。 它 着 良 于 根据 
某 些 已 知 条 件 ， 构 造 出 马尔 科 天 过 程 ， 或 者 说 ， 将 马尔 科 赤 过 程 
一 个 一 个 地 刻 划 出 来 。 这 样 可 以 根据 每 个 马尔 科 夫 过 程 的 共性 和 和 
个 性 来 研究 其 性 质 。 鲍 如 ， 基 于 构造 论 ， 可 以 比较 顺利 地 从 构造 
出 来 的 马尔 科 夫 过 程 的 类 型 中 ,挑选 出 具有 可 道 性 的 过 程 ， 如 辣 
专著 《可 逆 马 尔 科 夫 过 程 ? 中 做 过 的 那样 。 

上 前 解决 构造 论 的 方法 有 两 种 ， 一 种 是 分 析 方 法 ， 一 种 是 概 
率 方法 《各 有 其 优点 和 不 足 ), 均 取得 了 一 定 成 果 。 本 书 第 一 章 第 
三 节 对 此 作 了 概括 的 叙述 ， 

全 书 共 六 篇 ， 基 本 上 分 三 部 分 。 第 一 、 二 、 三 篇 谓 述 构造 论 
的 分 析 方 法 和 结果 。 第 四 、 五 篇 前 述 构造 论 的 概率 方法 和 结果 ， 
”以 及 两 种 方法 的 联系 ,第 六 篇 闹 述 与 构造 论 相 联系 的 马尔 科 夫 过 
程 的 某 些 性质 。 对 生 灭 过 程 给 以 较 高 的 重视 ， 这 不 仅 因为 生 灭 过 
程 有 它 本 身 的 理论 和 应 用 价值 ， 而 且 它 是 产生 解决 一 般 问 题 的 恩 
想 和 方法 的 源泉 。 

S—-ACRARONHOTEM. PARE ERE O 
RRO EI, UMRAO MDA TIPE, O 过 程 的 一 般 形 式 ; 然 
后 ， 对 简章 情形 的 Q 过 程 进行 了 直接 构 遗 ;最 后 讨论 了 Q 过 程 的 唯 
一 性 问题 ， 

第 二 篇 专 论 生 灭 过 程 构造 论 。 我 们 构造 了 全 部 双边 生 灭 过 程 
和 全 部 单 边 生 灭 过 程 ， 结 果 完 整 而 富有 启发 性 。 RA 

s ] 。 


造 论 对 于 理解 8 SRR, JEP ae, 

第 三 篇 研究 92 过程 的 马 亭 (Martin) 边界 及 其 在 构造 论 中 的 应 
H. 首先 ,我 们 将 离散 参数 马尔 科 天 链 的 马 亭 边界 理论 应用 于 如 过 
程 , 展开 了 广泛 和 深入 的 讨论 . 其 次 ,我 们 引进 了 最 小 & 过 程 的 马 
训 流 出 边界 ， 并 借助 流出 边界 对 Q 过 程 的 一 般 形 式 作 了 进一步 的 
AAU. 最 后 ,对 有 限 非 保守 、 有 限 流出 的 情况 构造 了 全 部 8 过 程 。 

第 四 篇 著 重 分 析 概 率 的 马 过 程 的 轨道 结构 首先， 我 们 引进 
玉 变 换 和 强 极 限 概 念 。W 姿 换 可 以 把 一 般 的 9 过 程 变换 成 各 种 轴 
道 结构 较 简 单 的 过 程 ， 这 样 便于 从 各 个 向 面 来 研究 过 程 的 轨道 . 
强 极限 定理 表明 ， 较 复杂 的 8 过 程 的 轨道 可 以 用 较 简单 的 9 过 程 
的 轨道 来 遂 近 。 其 次 ， 我 们 引进 飞 跃 区间 的 概念 来 研究 过 程 的 流 
出 和 流入 问题 ， 讨 论 了 飞 唉 区 间 、 飞 路 点 和 柯 氏 方程 组 之 间 的 关 
系 ， 导 出 了 流入 分 解 定理 。 最 后 ， 研 究 了 过 程 的 延 拓 ， 直 接地 构 
造 沁 简单 过 程 的 样本 轨道 ， 我 们 主要 考虑 DWI. WT IER 
后 过 程 保 持 Q 和 矩阵 不 变 ， 还 考虑 了 D" 型 延 拓 . 

第 五 篇 专 论 生 灭 过 程 的 概率 方法 构 遗 ， 由 于 过 程 特殊 ， 因 而 
结果 也 较 深刻 。 每 个 生 灭 过 程 不 仅 是 一 列 杜 寺 (Doob) 过 程 的 强 
极限 ， 而 且 它 还 与 一 列 特 征 数 烈 相对 应 我 们 建立 了 两 种 生 灭 过 
程 构造 论 的 联系 ， 使 分 析 方 法 构造 出 来 的 过 程 有 了 明确 的 概率 结 
构 ， 使 概率 方法 构造 出 来 的 过 程 具有 简洁 的 分 析 表 达 形 式 .这 样 ， 
便 可 以 发 挥 每 种 方法 的 长 处 。 两 种 方法 配合 使 用 ,效果 更 为 显著 ， 

第 六 篇 考 襄 了 马尔 科 夫 过 程 的 菜 些 性 质 ， 主 要 是 常 返 性 和 遍 
te. BORE Se, 

作者 圳 心地 感谢 王 梯 坤 老师 的 辛勤 指导 ， 没 有 他 的 指导 ， 这 
些 研究 成 果 是 不 可 能 取得 的 。 伐 振 挺 教授 常 与 作者 讨论 ， 使 作者 
获 益 非 小。 他 还 仔细 地 阅读 了 本 书 的 底稿 并 提出 许多 宝贵 的 政 进 
意见 ， 郭 青 蜂 副教授 、 吴 荣 、 悬 文 川 、 陈 木 法 等 同志 常 与 作者 讨 
沧 并 给 予 很 大 的 支持 和 芯 励 。 作 者 谦 向 以 上 诸位 表示 感谢 ， 
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J Pag BS AB PR Ge nee eee ce cee et cee cee ee cee ere eee eee 


(236) 


wi (238) 
(238) 
16 C2358) 
(240) 


(244) 
(249) 
(232) 


Fe) 
EEE soc cee cee ces cee cae eeeses ces senses ees atesetaes 
TV" RUBE, csecee ese cancee ren ean ane cen eee nae tanaee tesane ses 
BE Bd TE PG ans coe can ese toners cosa te cen ate cee ceases serene genes 


200) 
C256) © 


reves (257) 
(264) 
1+ (266) 
(267) 
vee COPS) 
1 (2TA) 
ee (276) 
reese (AFTO 
rere (283) 
(286) 
wt atenba ras NY 
道 近 最 小 县 过程， 
WA ETUR ai Pee soe see see etae rarere seo 
A WEL YAU HE Be E LEERD Q E eee 
JE RB EA E pE E, DY 型 延 拓 和 


(296) 


"e C297) 


(306) 


eared SUBD 
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参考 文献 ， 
索引 …… 


$17 MDP RA MCD TA gE iy.. 


ERIRE: 概率 方法 -- 


— E GE BEA 
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§ 2 EERDERE 

$ 3 —PFEC ROBE (Hnmnkun) 引 理 … 
§ 4 不 中 断 过 程 的 常 返 性 和 遍历 性 … 
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S 7 过程 的 概率 构 渤 ee 


第 十 二 章 两 种 生 灭 过 程 构造 论 的 关 么 eeren 


$i 引 育 … 
$2 Rh qua... 


§ 3 AE A UEN AL 
和 构造 论 相 联 系 的 马 氏 过 程 的 性 质 iio e 
第 十 三 章 BERD LINE Ber nero 


$i 5 引 育 … 


$2 最 小 过 程 的 一 aiid 


§ 3 EA EME 

$4 BERKS a 

ia MEHE mt ~ 

§1 aye se 

Sg] Bee 
§ 3 | RAY TT Ph ct creer ces cee rirare nirean 


§ A USE Ey Pi sce tes eee cen eee can rererere eeeeeeonnaee ens 


§6 MHWEKRHE- 


第 一 篇 ”构造 论 的 一 般 理 论 
Bre ”构造 论 引 论 


$1. 引 S 


本 章 中 我 们 介绍 桨 造 论 的 基本 结果 。 主 要 有 :， 过程 的 分 析 性 
质 ， 恕 连续 性 ，Q 和 矩阵 的 存在 性 ， 可 微分 性 ;过程 满足 柯 氏 方程 
组 的 条 件 ; 最 小 解 的 构造 和 性 质 ， 吕 过 程 的 一 般 形 式 等 等 。 大 部 
分 内 容 取 自 Rewter[1]。 4 和 5 以 及 定理 6.2 取 自 Chunelil, 
§ 8 的 结论 来 家 Reuter[2，3] 和 Feller[3]。 § § 10 一 12 来 自 疡 向 
HL. 


全 2 记号 和 定义 


REA HW FR, PARES. EEEE A Ht 
RE RRA GSO ARABERA, fc me wa 
记 为 js=supljil。 征 义 在 3 上 上 的 可 和 行 关 景 组 成 的 巴 拿 ae E N 


Wye, 9EE 的 范 数 记 为 joj = 之 ial, mfem, gor, HA 


E "(ARROW RRM PPR ee, 
“(2 D'A EML 14} ARKH RA eR, 
ar.2.1)” 和 * 定 通 3.2.17 分 别 表 示 第 三 章 第 二 节 中 的 第 一 起 和 定 班 1， 共 祭 类 推 ,，《 引 
型 编号 也 是 如 此 )， 


» J -æ 


Rey 
Lg f= Safi. (1) 
IEE 
RISERS, RARE Roh BY Pee. 


从 分 析 的 观点 看 ， 一 个 马尔 科 夫 过 程 或 简称 过 程 ， 是 指 一 族 满足 
PF FZ FE SARE P(t) = {pC} G, JEE, t0), 


PCf)S0, P(iji<t; (A) 
P{i+s)= P(t) P(s); (B) 
limP{4)=P(0) = Jų (C) 


O22 7 Se AL , AN UR B I CRAD AR, 4 表示 分 量 为 1 的 
MARE, KRSM. LER ARE. 

用 气 阵 已 Cf 的 元 素 表 示 $ AfA B) 《C) mA: SHER 
i, JEE, t08 


Pul 0, YY Dis(t) ly (A) 

piytt +s) = S palt) p(s) 7 (B) 
À 

limpa G = p10) =d {1 wi=}, (C) 

4a a, Wij, 


其 中 求 和 号 展 布 在 E 上 ， 通 常 称 (B》 HRA k — OY 显 
(Koamoropor-Chapman) 方程 。 


称 
CRESES E D Pilt) | (2) 
Sit FBP Ct) PRR. 
BIEI dO iRNR., MRAP i> oO. Ww 


TERR (t)=0, MMSE M— Yt Soma, 
ME tts, f>0, HOR (C), 


di(st+t)=1- © mls tt) 
J 


os 7 « 


=]- 之 > Pis(S) Bez Tt | 


T k 
=I- > Pals) > Peg CP) 2 1- > pals) 
i j È 
= diis). 
HEE ORIRE, BEREH, mere t>o — kE 
S p;i, Milds(s+¢)=0 >00, TES. 
1 
Meat CAD oodo GEE, Bp 


P(f)1=1, t>0, (D) 
或 等 价 地 


S PuG)=1, iCE, t>0, (D) 


时， 称 过 程 忆 六 为 不 中 断 的 ， 香 刚 称 为 中 思 的 ， 
MH PP), ARE PRA RP ARRAS Emi 到 
不 外 断 的 过 程 PCG, FEAR RERACE, (AE =F J{A},4 
Put) = Pul), Bal =4,(6), i, JEE, 
Pay Ct) = ft> == A 时 ， | 
0, i4/C ER, 


(3) 


直接 验证 人 恒 得 、 

引 理 2 P(O) ={r;(Ð} G, JEE, >00 BORE, WD 
PU) = {p(t)} G, JE E, tO) BREE. 

一 切 过 程 P(t) 组 成 的 类 记 为 多 ， 

HEPER, E= 0 GREP O GE, WRR 


di; = P; 700) = lim Fis St) PD PhO (4) 
FE, ME 
Gago ij, D apana, (5) 


Ful 


PU RBM = (a) Gd, CE) HBP WOME, 
Hgo, BARA ak. BTA — DARA RS Bee BB OQ 
EPA NE. PRAIA Peo PHOS BEF 
ite 
QE Gd d=q~ 之 d0, 
(6) 
为 了 强调 Pb E .9 与 有 限定 阵 吕 的 关系 5 和， 即 
三 (07 =Q, (7) 
BAR) HOU. RTA TR. OREP 的 一 
BRAS ASE SE A. AAO Or EB in 7.10), 


$3. 构造 问题 


构造 问题 是 相反 的 问题 。 除 了 Williams[215p, 224} 构造 
问题 的 研究 几乎 都 是 对 满足 (2.6) MOREA HY. 

oh EEO ME (2.6), RE = (di)ieg 为 如 的 非 保守 列 舌 量 ， 
Rd, = 0, BIA PIRES. AR 

H = {ild,;>o} (1) 

AERRSER ASE. WRN WH, ROWER. 

GEIR, AREMOHREC.6). AB, Ree 
HEr 满足 (2.7)? RAS, CHRBAHE? 问题 二 ,如 
时 过 程 丰 在， 是 否 崔 一 ? MH, MRO TR, mw 
Hi BRO? 

构造 问题 量 时 由 Kotmogorov[LI1] 于 1931 年 提 赂 ， 他 首先 导 出 
向 后 微分 方程 组 


PiS Sauds;G), FCF, t20, (KB) 
k 
和 和 向 前 微分 方程 组 
Pi = S Paltay, lyj EE, t20, (KF) 
h . 


* fg > 


1940 年 ，Fellerfi1 证 明 ， 台 过程 总 是 存在 的 。 他 并 且 构 造 了 一 个 
最 个 @ 过 程 ， 从 而 完满 地 解决 了 问题 一 ， 

1945 年 DeobL1] 诈 明 ， 对 保守 的 号 ， 或 者 只 有 一 个 品 过 程 ， 这 
就 是 最 小 如 过 程 。 或 者 有 无 穷 多 个 @ 过 程 。Reuter[1I] 对 保守 马 找 
出 了 Q 过 程 叭 一 的 充 要 条 忻 。 从 而 对 保守 的 矩阵 提 ， 完 满 地 解决 
了 问题 二 。 对 于 一 般 的 @@，1974 年 ， 懂 振 挺 教授 [1 得 到 了 Q 过 程 
的 唯一 性 准则 ， 从 而 ， 使 问题 二 得 到 彻底 解决 ， 

YFA, EHER u., HATH EHE H E aa A i 
大 致 有 两 种 。 一 种 吓 分 析 方 法 ,例如 ReuterL1 一 4], FellerL 1 一 5J， 
Williams[1-——-2], Ph$R7HL13, WiA1.2,61, Bw L1 一 31， 
主要 地 是 使 用 分 析 工 具 和 方法 求解 满足 柯 氏 各 后 或 向 前 方程 组 的 
@ 过 程 ， 或 求 出 口 过 程 Pt 所 产生 的 压缩 半 群 的 无穷 小 算 子 , 或 
求 出 QQ 过 程 的 预 解 算 子 。 另 一 种 方法 是 概率 方法 ， 即 极限 过 滤 法 ， 
这 种 方法 由 王 梓 坤 教授 [7] 于 1958 年 提出 ， 并 成 功 地 解决 了 生 灭 
过 程 的 构造 问题 CERES, ERED SHR, 22>, HEE 
思想 是 ， 用 结 袍 比较 简单 的 杜 萎 过 程 的 样本 东道 逼近 人 过 程 的 样 
本 轨道 ， 即 & 过 程 的 样本 轨道 是 一 列 杜 勃 过 程 的 样本 轨道 的 强 极 
E, IX HERR RRC OIA HE BLT AOI MRA. 

BBS? BERF, Reuterl2] Al 
孙 据 祖 [1J 对 Q 单 流出 时 构 道 了 全 部 Q 过 程 。FellerL3] 在 有 限 流 出 
各 有限 流入 的 情况 下 ， 求 出 了 同时 满足 柯 氏 向 后 各 向 前 方程 组 的 
全 部 过 程 。 作 者 [1J 在 与 费 惑 同样 的 假设 下 求 出 了 全 部 名 过 程 ， 
WiliamsLl2 和 钟 开 莱 [23 在 有 限 流出 假设 下 ， 求 出 了 全 部 人 过 程 ， 

因为 当 9@ 保 守 时 ， 任 何 避 过 程 都 满足 权 把 辣 后 方程 组 , mAg 
JES, OR BW DAW EM Be, APR i 形 
的 日 的 构造 问题 ， 较 少 文献 涉及 。 | 

对 于 仅 在 状态 0 可 以 不 必 保 守 的 生 灭 矩阵 Q, Feller(57 求 出 
TREES RR. WAST SE RE, FAL? 3 求 出 了 
全 部 生 灭 过 程 ， 即 嫩 可 以 满足 两 个 方程 组 之 一 ， 也 可 以 两 个 方程 
组 都 不 氏 足 的 生 灭 过 程 。 在 本 书 第 三 章 中 ， 对 于 一 般 的 怠 ， 当 亿 

= 5 >» 


Rt RNa Te UR BAe E, MOM 流 入 
RAE Se RT AAS BOG. 特别 地 ， 对 于 零 i 
HERA PARR PRA, IR SRO 过 程 。 在 本 书 第 七 音 
H, RTA RhA RERO, RET eR HE. 

HAZA- ER ase ie METWS LE, TARR R 
参考 文献 ， 


§ 4. Et 

EEI HPC) CH, WER CERRADO 
(Pilt ER) p| El- puh), (1) 
[dt th= hD EL pa, (2) 


Td A Epa ed (4) Mout Elo 0) kR, 
证 内 对 加 号 证 上 明 肛 可。 由 (2,B)， 


Pi (E+ R) = Pistt) = > Diy CA) Das CE) ~ Biz CE) 
h 
=| palh) -1p {t} + >) Dish) Daz (2), (3) 
hw} 


前 一 项 非 正 ， 后 一 项 非 负 县 去 之 Pu(h) <1- pu lh), ATT FRCL). 


HPC. DPI HPC 后 并 应 用 Pia FCB) GER, 
定理 ? KARKIT, blk, AAI uO RRK. 
证 由 定理 1， 2,4 Al-dib WEEZER, ARF 


引用 地 尼 (Dini) 定理 ( 梯 其 玛 逢 [1 第 14 页 )， 妈 可 ，。 
定理 3 Pho, Fist 


È jpu +h) = pyt) 24) 
SCENE. Shon, ERE S00 ERMAT. R 
ai, Wio 0 ，Pij(t》 FELO, œ) 工 一 致 连续， 

+ ő b 


证 Rosst, 由 (€2.A) (2,8), 


D> | pis +h) P) 
= z| 2, CP (S+R) ~ Pals) pst = 8) 
< 2 puts +h) — Pals) > Pag (4-8) 
=< 2 [Dals +h) Pals). (5) 
HEA., AR, AFEMI, PD 连续 ， 因 而 上 式 可 以 


seo, dima. Mied> on, 
a 
> | Pi +h) — plf) = > 于 | puts +h) — Pia E) lds, 
a 


但 当 0 反 Ps 时 ， 后 一 级 数 被 级 数 

S33| pacs)ds 
所 控制 ， 因 而 对 h E50, 站 一 致 连 线 。 但 依 { 梯 其 玛 希 [1]， 第 
404) — ERR, MPAA 


lim { (Dils +h) 一 Dints) |ds = Ü, (6) 
k= Jo 


从 而 对 fg 一 致 地 有 
lim > | pit +h) -— C8) | 


5 
<> Flim | | Pias +h) ~ Pila) [ds 


在 + 5 


= Zo 0. WE, 
h 
定理 4 在 O, œ) E, ES a> 0， Mixl, mM EF 
Pil) = 0 Bee; Cf) > 0. 


HE (一 ) (2.8), MERI>O, 有 


put) =| Pi(-)] atte, (7) 


Hi (2. Cal D >0, 
CD) Bitsy. 由 G.B), 
Piz Ct + 3) SPS) DiC), ($) 
WAR MSE > 0 Ar (to, Mait t E Pea, 
(HERTE > 0 fë 


Pali =0 COL Di (9) 
AT SURG A EAE RR, ee, ATER RNG 
E MSS, KELo, (10) 


& := TE 并 定义 


=IRipin(ms) >0},， m1, €11) 
出 (二 )， Am Amity WB = A,, B= A An-1 (Mtl 2), pie: 
REA,, 则 


0 = palms) = DS pj {Cm-1)stpy(s) 


= > pi{Cm—1)s} Pals), (12) 
Tr 
al . Pil =0, JCA, 3, REA, (13) 


HEEM, IMIN A. = Ania MAERAH 


Paim + 1ds) = D; pulms)Pa =0, REA., 
EA 
WAn =A,, 重复 论证 得 4 =A Dom), 特别 有 Ayn = Ayn, 
但 由 C9), TEA, LE An. XFAR EB, Cl<m<aNn) Wy 
非 空 集 且 互 不 相交 ， 
f1li<m<a2Nn, MACA, WRREA,, WH C13), HF 
pn, 


a 3 2 


ps{ (a+ 1)s) = (> +S + > Pilns) Pl), 


Tam fjeiim jeAm—-4 
由 于 (13)， 第 三 个 和 为 上 ， 从 而 
,之 Pal (at Ts 2 Dri ‘ns}+ >) pns). 


{fein 


ATOKA 1 AN I 求 和 得 


4N 
> palANy< © S ps), 


a i na fe Bm 


AIEA, F BPR UNS =c, W 


aN 
cx S > pps), txm<an, (14 


nai j iw 


由 于 B,， 了 ,-…，B,w 非 空 昌 互 不 相交， 故 至 少 存在 其 中 N 个 忆 (is 
n<ON), HSPRBHR (1，2，…,N) 不 相交 、 因 此 


Nex > > rij (ns), | (15) 


nmi | cH 


一 方面 ， 从 {10)， 
之 psa > puins) <E. 


『 >N 


HOD 布 方 严 格 小 于 N=Ne, 这 一 矛盾 证 明 (9) 不 可 能 成 
立 ， 证 毕 . 
KR RAE (OE, D LASFE, MBAS. 
证 ”结合 引 理 2.2 各 定理 4.4 即 可 ，。 


85. QQ 矩阵 的 存在 性 


定理 1 BPC, WHETICE, 
~ p‘:(0}= lim Pith) C1Y 
110 t 


存在 ， 但 可 能 无 穷 。 


证 ”由 定理 #4,4， 可 以 令 


Poi) = ~ npnl tf), (2) 
HEIDIME. 由 562.4 €2.B) 有 

Puls + E) SPa patt). (3) 
由 此 推出 

Dis hablo + PCH, (4) 
& aemp EE, (5) 


MRa, WERS 0 ， 存 在 tf。>0 使 了 (">q:-e。 而 
MHP oO, Bi, nt +O), MW 


ge Pte) s SPU + PO) Lat PD | PO) 


fo f; to i fy ° 
f 
s i> ORT, : 1, (2.0 P00, Mi 
Ü 
q-e< mO jim PO ca, 
E: 40 ria t 


由 于 se 任意 ， 故 jim SO sq, mao, RÈ q- 6 为 任意 大 


t+ @ 


的 正 数 M 进 行 讨论 ， 仍 然 有 lim °C? = co, 


而 lim DD mn Tn f1 Gp} 
rio H tio i 
~ lim lo PHO) 
i, a t ° 
. 由 此 得 证 定理 ， 
定理 2 对 任意 i 三 j， 
pi; (0) = lim Pig (6) 
存在 而 且 非 负 有 有限 ， 
证 #8 isi RASO, BM ph) =1, 
sD) = > Pin Bae, Da, iCh), (7) 


+. Jý * 


fide) = Pin, Par, Pa (BD (8) 


求 和 号 都 展 布 在 & +y Rh me Rimi, 虽然 我 们 用 分 析 
IAM BI) BRAGA), GSA LEN SER {Pis(h)} 
Ae is PRA BRR. MIM ARRAS AN Bl IK 
Iss, DRM ARS Bnd A RR. 

由 (2.4) (2.B), Wit 


a] 


Pisa) jb? (hp, (dp ,,{((n-m- 1h, (9) 


m— 1 
Pm) = mh) + Dh Gop, Cn ahy}, (10) 
z=] 


py (mh) = DS fii oppa m- ah}, (11) 
d-i 


PVR NYE, ERR FRYER. H.C), 对 
e< TEE > Ot 


max p;,(#)<e, max Pul FIE, 
Datat Patat 


} (12) 
min p(t >1—~e, ming; (ft) >1-e, 
patct Osta, 


pe te Je C113 49h 


> fif MU -e) <e, 


aj 


从 而 


> fi WM<1, | (13) 
eo A 
国 此 从 (10) 得 
Dri) Pa (mn) ~ max pai GN ~ ayh}, 
Fit, Wiwh<t,, Wn >i- ae, FEA (9) 得 
本 ił + 


a—Tt 


pinh) > (1 ~ 28) Yihad- eye ~ 8e)np,,(h), 


. m=i 


PsP) oguan Pu, ygenh<te, (14) 


Qı; = fim PsP? . 


yo” 
WE GD Aajs<o, WARE t 0<t, < ei 


Pu gs 
Í, i + 
EERTE EER., MEER > HË 
Ps) <q;;+28, |t-t,|<h, (15) 
对 性 意 的 RE O, minha, E, renti ,nh thet, 
FR C14), (15) 得 


(1 ~ ge) Ris <P. dij + 28. 


由 于 任意 ， Rit AB IMP < <4@i;. iE, 
Z MICE, ASR 


D,=d;(0) = lim) KD o (16) 
ff fei HA. | 
证 上 由 于 引 理 2.2， 具 需 将 定理 2 应 用 于 pisa(t) = ditf) ,有 妈 得 
(16), 
定理 3 WERICE, 有 
> BE (0) + di (O)< — Pii(0), (17) 


jme 


* Tz * 


证 A 
Peat). 4C) _1-p;;¢F 
> +o? = Pult) 


i i 


Fi Paiou s| 2 8017), 


§6. Fat 


PPCP, Q=(4;)={pi U ORM, Ba = -fus 
D,=d;(0), 

定理 1 «2M TRIE, col), 则 在 [0，co3》 中 怀 y (了 (对 一 
Fed (Oa ERDER SR, H 


‘Dist th) pu sah, fo0, ho, (1) 
df +h -di dh, t=0, keD, (2) 
> piz(to|+dic¢i)<2aq;, t>0, (3) 
Spil) +d; G) =0, >D, (4) 


pity tte = X Pili Paulas £0, t>o. 
k 


证 o M (4.7》 及 gj 的 定义 得 
Pih ee tui >i- dt, | | (6) 
由 此 及 《4.1)04.2) 得 0h (2), 
(1), (2) 说 明 pi; O Ad CH WRSRARAE, AME 


MERA, AMAJE Hi0, P(t), d; li (TEHE, 7 A. 
Pit) =e, + +f pi (ajdu, (7) 


dit) = [d udu, (8) 


D 4g rh BRU BHD DGEND ALOE, ©) FAA EE F 
at, 且 (57 对 tL SOs fo > OR. AE FEMME, § 2,25 E2]. 


(=) $A, tts) = PETS) Ps, t=0, s>o, 


Att, +g) =- di{t +t) dha) 
> 5 
由 于 Sa) +d NIRO ERE, BOA 
i 
D Mlt, tts) + ACF, 1+8)=0, 


Alt, t+s)>0, 
由 (4.2) 及 © # 


A.C, f+) LOPS) pt) - ais). 


HN ERRAA CER 
> At, f+- Das S-u, 
TrA jrid 


SEER C12), 从 aD 得 
S AiG, +s) 


pea 


= — > Aik, Eto- ACE t AHDS, 


jetta 
FRSHEBACE, 
D Ailt, 118)! <a, 


ped 
还 有 
OALE, f+8)=— > AG, AOSA. 


E (149015) PRA = (Ai, 20}, WA 
>, |A] = > Bist D> CADH, 


aol 
jaa i E-A 


e jd 


, $0, s>o. 


(9) 


(105 


(11> 


C12) 


(13) 


(i4) 


(15) 


(16 


(17) 


(18) 


由 此 得 
之 (Bi CF) | 2q, 19) 


只 要 牵涉 的 导数 存在 。 特别 地 ， 上 式 对 几乎 一 切实 0 成 立 ，。 
Æ (D 中 对 j 求 和 后 再 与 (> A, HF AD, A Laem 
求 和 与 积分 的 次 序 ， 于 是 


S piu(t)t+td(t)=1+ 六 | oi; (adi + fa (WwW) du 
f ? 


=1+ |'[E p’, (a) +d! (u) Ide, 
i | 
i D> Pis (u) + d; (u) |du =0, (20, 


从 而 对 几乎 一 切 1! 宇 0 有 
之 Bi CE) +i) = 0, (20) 


CS) 设 1 使 pf (ty, d/h ege, Ath (20) 成 立 。 往 证 
之 (= DB AG, tts -ph O0, 840, 
| (21) 
先 对 加 导 证 明 ， 由 于 1D, HB e>o, 可 以 选取 有 限 集 
ACEi 
4: > PD > |p) Ci <e, (22) 


fia jtd 


则 SS BAC tto- pRO] + D Atte 
pra Pa 
AS RHA; 二 0 的 指标 i 求 和 ， 则 由 14. (22, 
> lM;|= > A;ij—2 SS Ai; 
id joa jJd 
<D Atg D pua) 
EA GA 


= J5. 


< D Apte, (23) 


7 三 4 
Amh 11), 
YE A(t, t spu- SA A 3e, 
FA EA 


i 


由 CHCE 得 - 
lim © (90 Epi- di (t) +3e 
ria jeA . | 
= Spiy(t)+3e<de, 


je 


得 证 《21) 中 加 号 情形 。 
对 于 减 号 的 情形 ， 上 上面 的 论证 稍 作 修 改 后 仍然 有 效 ， RS 


(22) 式 的 将 是 
a> pyet DS |piscd[<e, GEE. (24) 


jed 7A 


HFE? ERER, (23) PAIN OMEA O Ct s) 


Ho RRM. 
《四 ) Biop; t), dao, E CO Bw, MAHE 


muti, HA CI), 
> lA, HH 二 3) ~ D Piatt) Dy, (e t) 
h 


=! S Aali, +8) — Pit) pH- t) | 
j Ai 

=< SS Anl, EAS- pil, s40, (25) 
A 


由 此 得 


Au, u9- S|- Epi pm) 
7 k 


| 


» 16 * 


ax > Aalt, Di -0, $40. 
Me), dtu) 的 右 导数 存在 ， 类 做 可 证 亡 导 数 也 存 候 。 因 地 
Bis), diate G, œ) HPE, ME. 


Pi; = S piP E), (26) 
k 


diaos > phm. (27) 
A 


E GD REA pi, H), di(afluc(t, co) 的 连续 函 
oy, BES C). ERA > OMT RACED, Alb! (t), dict) 
在 00, °°) bE, THEBSRR, HE CO (3) 成 立 。 因 
为 (19) 对 一 茹 t>0 都 成 立 ， 根 据 引 理 2.2， 应 用 结论 (19) 于 


P Ct) (RFCS). 


CH) thik 
limp; y(t) = p7,;€0), limd: (4) = dito), (28) 
rig t 


内 证 前 一 式 即 可 ， 因为 按照 引 理 2.2， 应 用 前 一 式 的 结论 于 


了 《ft 所 即 得 后 一 了 式 。 
m6), Pilt +h) Pihan D ~ 1,2) 


= ghp Ct), (29) 
red | | 
RR, Ct) =pi Cl) +a CS 0, (30) 
Aad o E C.B eA 
Rijtt + $)= > RaP), S>0, Fd, (313 
A ` 
Te 


Ry; Ci +s) R; EP, 
Hpi, co) 上 的 连续 性 ， 得 
Ris (8) > lim Rs; (4)P 5:08) Hm: (8) Tim g, i). 


4a 


+ JZ ©) 


BimR OPH, Mlm 存在 。 再 由 数学 分 析 中 的 中 信 


定理 得 
limpi; (t) = p13(0), iP, 
了 系 ”如 qi<ece， 则 对 任意 4>>0， 对 4 一 焉 地 有 
Pia Ce + 8) ~ PiE) _ one = 
lim > | DICAR pua |=0, (32) 


zat 


TE 由 CD B® CS) 得 出 。 
定理 2 ee yao, MINIM ICH, pi, EL, 
0) EA ARES SS, 1A . 


D'it) = D> Pil EP'e), Feed, s>0, 
Ak 


(33) 
证 由 (4.8) 及 (6), 
Pil t+h}— py (Dp Dp) — 1] e pi hah, 
故 
Dp fet] = Dp; Cf) + pig fa; jet ited, 
REDERE TF YA, AT M RM Py Oen EE, MEDO) 
LERAM. 
A jC} Dpi E + Pist DG, (34) 
BS (2.8}) 为 


Pip (s+ bet FO senit D Palp OE, 
È 


BERRI A EJE FubinD BM, MENAIP A 


USH t) = D p(t)vss(s), (35) 
R 


WEHE Faton S/H, MA — Hs, t20g 


DifS 二 有 D patos), (36) 
È 


+ J 所 


tee 2) Heb, 

OOO ta) Pik ta — $907,038) 
SUL Re HEt Re OLE AREA LAA. H 
襄 比 尼 定 理 得 GD 对 35EZ 及 1EZ mar, HoP ZAZ, 的 测度 为 
F. HET EZ, BERRIA 


lE tSo) > Pil EUn So)» (37) 
f 
HUA tf > te 
u(t +3.) Sait! FU (Ct + sy) 
f 


> SS py Ct i) D pit uej€55) 
| f 


= Y Pil #7045080), 
ko, 


Fs EZ (35) 对 几乎 一 切 # 成 立 ， 上 式 是 不 可 能 的 ， 从 而 当 
SEZHZEBSR, Rk, W> Ht, 0<s’<shs’ eZ, WW 
vij(it+s}=uzsCf+ts—s? +87) 


1 


Y Die f -HS Si YUS") 
b 


ni 


> > Piri th (S— suas) = > Pits), 
E 


È t 


Amz, HE (35) 鸡 一 切 !1 冯 0，8>0 胞 了 立 ， 

B t0, Hiv td, Ea p OEV aC E + tn) >ii; CTE t tr) > 
aij Ab <t,. HH (35)， 

(i+ aS pulta taut + fn}, 

Maymi, BAIRE, args ais, Mot + OC 20) HE, RK 
似 地 可 证 27;Ct 一 07)(f>>0》 存 在， 而 且 由 VCE + Ba) Cui; 
(HJ v(t +v OL SO), Hest) Pili, vist O a’ 
Ue Ci Seu; (Ft 0 0), PE up +0) 0; Cty; Ct -0), 
Wi>o, WROL, Bat 


+ 79 + 


Vikt- En) 一 > PiL E Sse faje tS), 
À 


Utt — 0) Spl =S) D = 02,08}, 
k 


XPE, valO O, œ) EES Amp OE (0,c2) 上 有 连 
RRB EFRD OO, WSL ZO, co) bE SERS Ap) 
(Saks( 1], 204m), MAAR 00+ 存在 , 即 pi;(0+) = 
imp (DFE. APIE ) = pi)(0)， 于 是 piy(t) 


#2 (0, co} 上 上 连续， 并 且 对 一 切 0，s20 成 立 的 《35)》 成 为 
(33), HEB, 


$7, - 柯 氏 方程 组 


设 PLt) EP， (6.5) 对 和 =0 6.3D 对 s=0 来 必 成 立 ， 即 
Wg ckt, 


pi s(t) = È GPs), t=0, JEE, (KB;) 
Fb PETE, g<}, 

pis(#)= D Dir(t)qrs, 1>0, IEE, (KF,) 
Ah Re. ME 

Ai;(f, t+s)= È A860, ps E) 

= E Pi Ast0, 8) | 


O Piah S liD lE), to=0, JEE, a 
| 人 
Hga okt, 
s 70 * 


Pi OS > Palle t20, EEE, (2) 
f} 


分 别称 《1》 和 (2D 为 向 后 不 等 式 组 和 向 前 不 等 式 组 。 而 称 方程 
组 (KBi)(iEEB) 即 (3,KB) 汶 向 后 方程 组 ， 称 方程 组 (KFj)(j EE》 
如 (3.KF) 为 向 前 方程 组 ， 


应 用 引 理 2.2 中 的 F(t) 到 《1)， 我 们 得 | 
di> Sadi tD, (3) 
k , 


HPD; = di 00, 

WEP) EF, FFACKB RKP, Ra, Ma Raa, JF 
Hpi =g G EERIE). ARPG d E E R a A E 
Ho. WP OEO, HPN EE FAQ)。 实 际 上 ， 由 CKB;), 


pia) = GaP lt) + DS qupu(t), 
ri 


Wam, PEE (KF fa A, Æ (KB) 或 (KF;》 中 取 
t= Hpi; D =4;, 

HAH al, QQ 过 程 P(f) EPO) 满足 向 后 或 向 前 方程 组 的 条 
件 是 什么 ? 我 们 将 讨论 这 一 问题 ， 

引 理 1 PCH Ep，(KBi) 对 几乎 一 切 t 成 立 。 则 (KB;》 对 


WRA. 
ME HERE AMM., mHE 
Pilt) =O, 4 i[ > Gina) |du, So. (4) 
由 于 《2.6)， 被 积 表达 式 连续 ， 对 + 微分 得 KB) xt—tt>om 
Ve | 
定理 2 RPCP, WME, (KB) 成 立 的 充 要 条 人 忻 是 
qR, E. 
之 4r+Di=0 (5) 


其 中 D; = di (o>, 


和 jj « 


证 KB) Rar, Ma eRe 
Pit) = 之 4 > Bast, 
由 (6.4)， 上 式 即 
=d; (t) = D all ~ ADI, 


出 定理 6.1， 令 i 一 0 得 
-D; = > dias 
A 


BP C5). 
反之 ， 设 8 有 限量 《5)》 成 立 ， 则 由 《1)7、(3) 及 (6,4) 得 


o= Spidi + Giallo dCt)] 
i A 


+ > Ged Cf) + Di = Didi + Di = 0, 
A k 


因此 (O PERSA., (KB) W, 证 完 . 
HARR T, BI 


qi= D lL (ii) 


RM, ARES. Oe DO = 0. he CS) Beak, PAS 2 的 推 
论 ， 我 们 有 

定理 3 4 (8) RAC, (KB, mor. FW, YOR Sat, 
每 个 如 过 程 满足 向 后 方程 组 。 

因此 ， 当 吕 保 守 寺 ,构造 问题 较为 简单 ， 求 出 全 部 @ 过 程 的 问 
题 成 为 求 出 满足 向 后 方程 组 的 全 部 过 程 的 问题 . 

定理 4 设 了 (tf) EQ)。 问 后 方程 组 成 立 的 亮 要 条 性 是 对 
HKO, 


. 上 +R) f 
lim > [Pu +B) = Mh) Z turu | =O. 


(7) 
e 7? + 


[ey FN 2 2 ee EE PPE ER ES 8, 
pittt Tma) > DiaCt Qs; 


lim 
t+ i 


=, 


(8) 
证 必要 性 由 定理 6,1 的 系 推出 ， 充 分 性 是 明显 的 . 
定理 5 设 P(1)}E .PP， WEHA G.F) HILE — Hi 

zR, WoE- roA 
证 RZHEWH, HteZH, (3. KORY. BEA 


Piki) = d+ | E puas Jeu 
Om k 
0 + i; {pesca rete + 《I 一 ds| isu date 
it] 


Ps) — G5 3g, 1f py (urdu 
ft Ede. . 


+{(1- apat pudu, 


Aa. DORES. 105.2, W 


dis =P; (0) di + (1 0396501; = ija (9) 
因此 data>> ~ oo, Aa, ALAARA (2) 
有 


PDS S Pae (fg, $0. 
k 
结合 1EZ 的 (3,KR) 得 
S pint) (Ga ~ Ges) KO, FEZ, i, FEE, 
k 
出 于 每 一 项 非 负 ， 特别 有 Pu(f) C91; ~ hz) = 0 GEZ), Kit a, 
=s BPI = qi;y。 于 是 当 t = 0 时 ，(3,KFy 是 成 空前 。 


设 w>>0 有 WEZ， 可 找 1>0 使 teZ, 0<u~te2, TERE 
理 6,2， | 


piste) = DS pupi (ut) 
I 


. 23 


= 之 Bilt) S Pula t day 
3 k 


= Z| Ee By, CU 一 H] Ges = Dy PiE) Gaja 
p Ls k . 


AE, 设 P(t) CH, MR AT BA, > Pis (tae 
TEMA MRK AILO, TIL — Bou, 

HE yet 4.16.2, OFDM Oa, REA. RAR 
z| FA Hie se BE BVT 


我 们 指出 ， 如 果 只 构造 满足 向 后 方程 组 的 8 过 程 ， 可 以 将 非 
保守 的 情形 化 为 保守 的 情形 . 


定理 7 BPO) E 249) 清 足 向 后 方程 组 ;P (1 = (gD) 


G, jEE) 按 C.D WE. HERE O= p00) 保守 ,P (1) 满足 向 
后 方程 组 。 


证 is 0=(" o) 其 中 卫 = {Dijies HARE, HIE 
理 ?，@ 保守 。 根 据 (3.KB)， 可 见 
P= San Plt), i, JCE, (10) 


对 1，j EE 是 成 立 的 ， 对 i=4，jEEB EBA RwW. WCE, 
j=A, (10) 成 为 


Ct) = $ dt) + Dis | (11) 
片 


当 t= 0 时 ， 上 式 显 然 成 立 。 当 + om, EAA G.KB) & 
(6.4) 得 出 ， 证 上 毕 ,. 


ARAF 


BPC) CP, BBP) RRM MYA) = (4,0) G, 
a ‘34 - 


Bis y= [epi (ode, A>, (19 


BRYA) A>O) And RPC) BRAT. 
由 (2, 有 4 一 C)， 我 们 得， 对 任意 i, ICE, A, BOO, 


pih 0, A D pul; (2) 


Wig) 一 gC + Ch) D dad Pay UD = 05 (3) 
k 


limp A = dg, (4) 


称 ( 2 ) 为 范 人 条 件 ， 称 ( 3 ) 为 预 解 方程 ， 称 (和 为 连续 性 条件 ，。《2) 
《84 的 年 阵 形式 为 


YAISO, APLS; (5) 
PAD ~ PU) + CK 2) CA) Ce) = Oy (6) 
ma 0 
由 (2.D) 得 | 
AD, uA), | (8) 
或 ACAD E = 4, (9) 
条 后 各 刘 前 不 等 式 组 (7 DRAT. DRA 
heyy (A) Bi D Gat A), (10) 
l k 
Ahi ;2 TD ti gs, | {11) 
A 
由 定理 7.3， 
APA) Di Gin (A) =G, iEBE-H, (12) 
k . 
这 星 五 是 非 保守 状态 集 。 


定理 1， $0) OA>OBRREPODC PHMRAT HRD BE 
PRR. DRJ ERES RI. POR iY 


s 25 * 


充 要 条 件 是 9) 成 立 。 

证 。 必 又 狂 已 证 明 ， 下 面 证 充分 性 ， 

APA 为 作用 在 $2 开头 叙述 的 巴 拿 赫 空间 XZ 上 的 线性 算 子 ， 
JEE, GPA Er. 


Egyh) = ELION (13) 


由 于 范 条 人 性， 和 %) 是 F 到 了 中 的 非 负 线性 算 于 ， 其 范 数 界 于 和 '。 
由 于 预 解 方 程 ， 在 一 致 算 子 招 扑 中 ， 


(=O = np) Tt | (14) 
于 是 有 
0 aah, (15) 


(16) 


o<(- -全 ) 之 Yi AS ri 。 
利用 完全 单调 函数 理论 CPR, A Fellerl6], 2#, 415 
—418), MAGODD: WO) BERAE Bes OAN 

zr, H (15 (16) 得 下 面 二 式 
O<f Cf) <1, (17) 


ox & fC <1 (18) 


对 此 乎 一 切 to RI, ET RE SA, GE 
fuc 的 值 ， 可 以 使 得 C17) (18 对 一 HI #>0 盛 立 。 我 们 人 恨 定 
忆 作 了 此 修正 ， 

其 次 ， 我 们 证 明 ， 按 平 面 上 的 惑 员 烙 测 度 ， 对 几乎 一 切 非 负 
的 5 和 1， 有 有 


Jisa t= SD fatohgd). C19) 


FR Be fe or PEE, REE C2) REM 
= 7G * 


["["-e eds 
bo 


相等 。 当 X 守 VY 时 ，(19》 两 边 的 双重 拉 普 拉 斯 变换 是 
(VR bi) oD Dvds, 
依 预 解 方 程 ， 它 们 是 相等 的 。 令 A>vY， 由 《14 B19) 两 按 的 
双重 拉 普 拉 斯 变换 当 和 =% 时 也 是 可 等 的 。 
现在 ， 我 们 将 在 一 零 测 集 上 改变 fi;(f) 的 值 而 得 nG, 


Cpistt)) 是 号 尔 科 夫 过 程 。 对 t=, REEM P= di Xt 
0， 我 们 定 立 


pist 1}=1 ! > Rico ~—ujdu 


k 


sii | DDG du (20) 
Dh h 


H% 09 对 几乎 一 外 Cs, O) Ber, AOL Foi, 
(14) PRR IAR Laue 00, OFAC, Ait 
PDS fu HILF, (21) 
其 次 ， 国 数 
KORIN Jiltje t —ujdu 
fen Be a ee oW BER. AMRESH. i 


> Gal 站 被 级 数 


S| fatwan - (22) 
k 0 


逐 项 控制 ， 又 级 数 〈22) 的 每 一 项 都 是 连续 的 。 因 此 ， 依 地 尼 定 
理 ， 级 数 (22) 在 任何 有 限 区 间 CO, T] 中 一 致 收 化 ， Mii BAR 


TOEO, TIPE, FEO) =i Dot tye co, 
T) 中 连续 ， 故 


piytt) FECO, co) eee, (23) 
AR (210 (23), M a7) 得 | 


Op (A )<1 xt —BWt>o, | (24) 
A (18) (21) 

> py) (25) 

7 


对 几乎 一 切 f>0 成 立 ， 由 (23)， 利 用 Fatou 引 理 ， 可 得 上 式 对 一 
Bl t> 0 成 立 。 | 

我 们 已 经 证 明 p(tt) =; GWE (2.4) A G. OC). ELE 
pCi) BREE C.B), #88 2D BR 19) 对 几乎 一 切 (s，#) 
Rear, BATA 


Pils +t) = DS prin( SDC 对 几乎 一 切 (s，+), (26) 
k 


K (23), ERSA > 0, t> Oe eH. AE, AiE (26) 对 
一 切 s>>0，t>>0 成 立 ， 只 需 证 明 ， 指 定 ?>0,， (26) ADA t> Oe 
续 ; #Et>O, (26) EFt. EOD (25)， 前 一 事实 
是 正确 的 。 为 证 后 一 事实 ， 只 需 说 明 指 定 t>0 时 ， 级 煞 


` Die(S)PajCF) 
k 


E EHE, 6] CO<a<b) hik AT 244, Aw 
明 级 数 之 Pats) FEL, blh Bose. Sb, H20), 


Seur | [S > Safi- u) la 

=i") fis kj i- ) |du, 

Zf o| ‘ u) | u 
由 (18)， 上 面 的 级 数 D 被 级 数 (32) 所 控制 ， 而 已 指出 级 数 (22) 
在 任何 有 限 区 间 [0，T] pgg ETA E puC) 在 区 间 


# J2 « 


a, blth. 

我 们 已 证 明 P(f) = (pt》 的 元 素 是 可 测 函 数量 〈2.A) 利 
(2.B) 成 立 ， 即 Pi) = (piy(1)) 是 可 测 的 广 转移 矩阵 ， 因 面 极限 
lim pis(1)=wiy 存 在 《 见 王 样 韩 [2]，$ 2.1521). A a A BY 


R TALE eT BE Be BS Ba AR HE A lim i 5A) = lim Di; CG, B 


注意 $C(%》 的 连续 性 条 件 《7)， 因 而 (2.C) wear, GRR, PCE) = 
(mt)) 是 马尔 科 夫 过 程 ， 它 的 预 解 矩 阵 就 是 已 给 的 CC). Fab 
性 证 完 ， | 

EPG yR HR. BAOD ARIE. BS. 设 (9) WRAL, WER 
某 个 # 全 0 有 So OLI, WH. 4.4K, NM o 有 


ZPD, 只 而 (9) 不 可 能 成 立 。 这 样 ，(9) RAPA AM 


By. LER. 
定理 2. HPC 的 密度 矩阵 为 Q=), WETA 
PCA, W 
= limh {Ahi (4) — 5; ;} C27) 


WE. aA En, HEAS, FEIDE tAd, 
| es = Fes -gs| <E, 
TÆ ALADA) — 03} — asl | 
= jas [eR CE) iy ~ gist HE 
atf eerdt srt ecza [gil fydt 
=ef e (Ag+ 1) 41} tae + qle dr 1), 


24,» oo hy 4B 
lim {A {4; A) — di;} aiul EE, 


由 8 的 任意 性 ， 得 (27)。 


eo 74 + 


“qi tibia, HEEN 0, TEA, Mich, 


Puli) =I oy 


于 是 Miva) 一 1 和 全 ep 


| eh —Nijdt= —N{ 一 上 人 -13 二 1} 
L 


we N, (Aco), 
H 点 的 任意 性 ， lima {Abie — 1} = —oo, TEE. 


MOB. MAE CAT HORE, 
EEI, PAASO) OWE PEPO RR TEHE 
分 必要 条 件 是 范 条 件 、 预 解 方程 和 @ 条 忻 成 立 ， 
证 ， 这 是 很 明显 的 ， 因 为 8 SHAS BSH. 
今 所 我 们 将 直 反 称 过 程 或 号 过 程 P(?) 的 预 解 算 子 OCA CA 0) 
为 过 程 或 昌 过 程 ， 并 有 旦 世 记 为 NE 多 或 AIC AQ), RIP 
不 会 引起 混 清 ， 
定理 4， 设 8 有限 。 VAE (0) 满足 柯 氏 向 后 方程 组 (3. 
KB) aE BEA. MRR: 
(AI-Q)p(A) =I, ADO, (28) 
Rit, BREW TKRRRERA 
Aes CA) = 之 Tate A) = dijs A>>0, i, JEE, (29) 
证 ,在 (3， BOD TR ROE SUA SERED BR A (2, © 


JIBRED., PRUE PE, 
充分 性 。 HHEN RAS AD YAH OG 


PA 40, AR CO, (30) 
从 而 青 由 CD 得 

(A+ 4))0:;(4) f i, A foo, (31> - 
故 大 各 7 一 有， 大 > 。 (32) 


即 连 续 性 条 件 成 立 。 再 由 (29)， 
+* $f + 


ALA: CA) Oy = > iA fA), (33) 
k 


出 《32) BES. MORE RI, Alb HAVE 21), 
KEAL LRE. 1, PGO 这 giPrsy Ct) ARR ESE 
| 


EM. MRE ARM, MoT aS. 
即 向 后 方程 组 (3, KBD 成 立 ， 证 毕 。 
EEs, ROAM, VO) EFP (OBR MEHKRA MARA (3， 
KF) 的 充分 必要 条 件 是 范 条 件 、 预 解 方程 及 F 条 件 ， 
yA- OQ) =I, aSo, (34) 
成 立 ，F 条 件 的 元 素 表 示 形 式 为 


Ap; (A) — SS BAe = 0, A™>O, 1, JEL, (a5) 
k 
证 。 在 (3.KF) 两 边 取 科普 拉 斯 变 挫 并 注意 初始 条 人 性 (2. ©) 
PPS ECGS), USE EERIE. 
Fes FE. C35) 47030) eRe te. Wk C35) Be 


Big AVA a) 44:3, A foo, (35) 
HOHE. EAR), 
MAW A) — iih D bila Ges, (37) 
k ` 


HORRET, Myo EFO, | 
O35), HLERA OSAR D he Oa; SHAME 
` k 


aie, KM Eei ILA as. BR CS KPA LE tS 
Ont, fHERH7.5, WTR KAORI, De, 
定 灾 4 BR C28 BR CaS ANAS AB RP. 


§9. 费 勒 的 存在 定理 


给 定 和 矩阵 昌 满 是 C.o, CHREAG? ai, 7,10) 是 
. 37° 


BA SR? FellerLljHRT MPa, ae oP eM. 
eM, (fCSomeF, 
TGO, 


Fit =de +e aan | Safi sce) yer "Ju, | 


"Kero 


(1) 
Be a Ot He 
7304) =0 


Tij G) = Oe e KAN pi aa | edu, 


(2) 
Ar fh s(t) A Jaldi), woo, (3) 
为 了 遂 明 D 与 D Fi: BRET LG BRAG; ADA 
> O) Refit) ATT EEE A), 
OF (4) =O, 


T 二 1 dik R (4) 
FICA = —_—__d,; 一 j A æ 
Pr A) NE g; + 之 Naa, Ph CA) 
BY of CA) = 0, 
1 Gs (5) 
Ortlir~Ay= Gi 十 +; Aai | 
Ff A+ 4; 之 it 
(33 成 为 
pih FGA), BE, (6) 
Rei 0 与 《5) SPR, RAR SRAR, S 
H = Ci; 30s 
m=) . di (79 
Oi; 5 mg = Of. 
SA) = {lA}; 
(th) = 和， 
HO) = Th, (8) 
令 对 角形 矩阵 


* 57 * 


Ml +q=diag(A+a;), | (9) 
则 (4) 成 为 | | 

po (Ad =O, 

bl = ILI +H Aye A), 
归纳 便 知 

bays SAA +Q, 20, (10) 


从 (5) 得 

P(A) = 0, 

Ort) (A) = OANA + ay! LEOL MOAT 4 gy, 
归纳 仍 得 (10)。 于 是 (6) 成 为 


OAD = So TPCA) (AL +g) FO(A), 大 -co ， (11) 
=: 0 


定理 1。 SO) EFQ) HR ERLE EAM BA, G) 
ERODE, MMERPOD 5 9,(Q)， 有 | 
Pt (ty, t>0, i, JEE, (12) 
定理 RMRATOO MRRP: 
定理 2。 GAC 710), HERA RAANDRA. 60) 
最 小 8 过 程 ， 即 对 任何 (MX) CeO 
Pi) Ah0, i, JEE, (13) 
ASAE 2B. BESO EVER. RE, 
BRP, He A13) eae. 


CORE ATE BIN, EAMA DONI 


Ai SRE ATE, 
Wy VERT OCA) AY TO a ek, A ERA ST — Wnt 
H CACAL + gy t = Fie Ce) (eT + ag! 


= (EA) SPA A+ gt) (ul +, (14) 


a—it 


因为 在 上 式 中 对 +# 求 和 便 得 预 解 方程 ， 
+ 33 


PED, WAOE An WA 
AVA, = An MAAL P aay, 
(15> 
当 # = On (1 mir, HOO ema. WA) 作用 到 
(DpAWEe 
MAA, = H CA CAD + 90) MKA (a Cel + gq! 
= UT (AY CAT +) 74 — Et a) Gul +g) 7 
一 【下 一 大 ) ADE QIU AL +g’, 
将 上 式 代 入 (15) eRe + Re a A GO Aaa. TE 
{14) 对 一 切 # 成 立 。 
Hc, (H 


(A+ GQ tM) = dit Sandi, | (16) 
Eig 

PTICA taD = 0), + SOT, (17) 
kw} 


Anco pO o BS HERP SR ELT. 

BR. EPA CFD., Bed, A) Sel, A). 8.10) A 
(4) FRI aE Ba (A) ot, QO aT n par. MAT F138). 证 
re . 


$10. 最 小 解 的 性 质 


5] 5 1 Ejo, gs0., Wan t onf, 


Ent dADS, | (1) 
Te + Gd(A), . | (2) 
其 中 外 由 下 式 确 定 ， 
ga 0, 
a+] fi Gis E» (3) 
Er REg, + 之 Ata; 7°" 
at rh PF aA WAGE a 


+ 34 + 


C4) 


A+ 4, K+," 

Rel ef, m=oeA), MODRA, FEH 
(9.16)09.217)5(3) C4) eae 
3: tfSe, muf E 


(A +9, 30; = ists th, tC E, | 


1 + 一 Us + Sni- aay 
be- j 


jaj} 
Qu ce, 
muzta, 
Khg=0, eg 


UA +g; = Dds + Oy JOE, | 
i Fn} (6) 
Gp OO, 


mjog), 
E REM pgm., Besét-0, 由 (MORCA 六 
E, Migusdaasr, 证 毕 ， 


FA, A=I+ ipp), A, >00. (7) 
引 理 3 A, AAR, AMER, vw, v>o, 
AU, MAGA, v= Ath, V), (8) 
O(wyAch, A=ACw, AP = OCA), (93 
特别 地 
A(t, WAG, B=! (10) 


HAC, FETE RAMA, ERA GRA, p). 
证 AAO MGRAAMBAR BGA, DAF (8), 
(9). 
记 方 程 组 
(Ua) uj- > git =0, TB, (11) 


1) HMM AHF, ja aun laula, 
f 


a }5 站 


RR ue meek a JER EmA EEA mip 
为 下 的 全 体 记 为 .4 (KE)。 记 方程 组 


(Vy) hus— D7 Vids = 0, JEE, (12) 


A HU CESS, ARC SiS ri. 
引 理 4 如 7E.Y Mei, WAM, DIEMI MJE 
7, Ret, WAU, MCL imei, 
证 RSC.¢7,, WHOA BRE, 
OAC, f= Of + u MOG AIS 
= aft (nAPO A 
=AA(u, A/C me, 


bt hk ey] 


RMAC, ADS EM, 
wefc.ai, 4Asuit, wR 
Ath, F=f +u- S0, (13) 
Ha>, Æ 
OI- Qf = -mf =0, l 
H52, JAPAO- f, BMA, ASO. 
JA, 1 EFRA RHEN, 
定理 5 = AGCA)LH=1-—O(A)d-XCA), Pp 
2 WSI 之 go) -XA (14) 


其 中 瑟 为 非 保守 状态 集 ， 三 = (d HREF. AO) 是 
方程 


(AI- QR =0, . _ 
NEI, | (15) 
ARK, Bev aT AO), wep : 
wea St Sik ys 6 
a 2 | (16) 


HE OCA) BSR EP OO E | 
»« 36 * 


CAI- Obed = 有, CIF) 
(I-O) -AHAD = (AT-— Q)L-AD= ~ Q1=d, 
. (18) 
由 下 理 2， 
1 一 大 
从 而 由 (173f18) 知 
X(h) =A ~ BN) 
是 方程 (15) 的 解 ， 并 得 到 (14)， 
ABEL, 1-X(A) =O(A) O14 是 上 天 列 &" 的 极限 ， 其 中 


£1 -== 0, 

K+d; 可 ; | (19) 
+i 一 } if ER 
i Kia nrg 


AMAO E FEAU = 1 — SAR PR. HEARS), | 
最 后 ， 设 # 蚌 方程 (15) 的 解 ， 则 由 ww 所 1 有 w= WAU”), 
Hua MOD, 于 是 ws limn") 二 (入)。， 邑 下 以) 是 方程 (15) 欧 
最 大 解 ， 证 毕 ， 
引 理 6 Buc .#,A|lul|<1, Wi 
—~X (AUX (A), (20) 
i ” 声 方 不 等 式 已 在 定理 5 中 证 明 , 左 方 不 等 起 可 类 似 证 明 ， 
S/T eX (A)+a, H 


sup; (0) = 1, inf 之 iuda = 0, (21) 


cen 


inf O(a I] = 0, uC Me, | (22) 

证 esula, Mo<acl, Ma tX(Ewid), 
YO) MRA, a XOS, tHhi<e, BUa=1, BP 

supX (4) =1, 由 此 及 (14) 得 inf D bial ddd, = 0 及 infLXd(X)1i = 


aad 


0; HA TH FS INELHCA uj; = ORTH cm, wesc. 


§ 11， 流 出 族 和 流入 族 


定义 1 FREA), ASO AAR. HER, Ro 
EO EME | 
EC) = AA, BEGA), A, HS0. | (1) 
MEEO C iP FPR CECAD, XO) 称 为 列 协 调解 族 ， 世 称 
Va Fl ii OR. 
Pn), A>O WTR, HP TEAK, MEENA El, 
且 
NCH) = HACADACA, H), A, BOO, (2) 
HEIO) © SiRF eM On), A>0) 称 为 行 协调 解 族 ， 也 称 
调和 流入 族 ， 
BR, MPR) RAG), A | | 
«EAD, 2d), Cf oo), | (3) 
TW ASA) = 0 或 只 A) = OMIA, RIX —DWA> ORES. 
M2 F 


= mE) (4) 
hy PY BP PRE (A) CAS 0) FSR HERR SR OBR 


n= linyny() : (5) 


HBA) OD ORE. 
引 理 1 BEWARE MRA, MD 


B= E(u) + HTECK), K>. (6) 
E=E(A) + MB(ADE, A>0, a (7) 
其 中 r = img) = > iq, | (3) 


1} #0 we reels, arm 


>» 3 + 


BEN FTE CA) RE RM 


R= BCR) +e, Bod, (5) 

=A) HARPA), AD>O, (10) 
证 A | 

ECA} = ËCH) + Cu APUNE), (11) 

ECH) =E(A) + A wide). (12) 


如 果 D Pisa <oo, EOD 4 p o. WE 
SUE) =o, CISA 10, 由 法 都 引 理 ， 


E, 28; (i) te È Tite) = = 


因而 ( 6 HEARR. REER RE) P Se | 0T. 
ALC 10) Wy 26 AELH HE BA HEE. 
系 ”指定 i,， com ARS ART CAMO) A> 
TAPA IG]; = ATEO I]; oo, 
此 时 
[A@(A)€]; = Ei 一 i D0, 
同样 地 ， 指 定 ij， 和 之 50 当 上 且 仅 当 对 某 个 《从 而 一 切 ) A> 0 有 
LANECA) = CANO yo, 
此 时 
LAq@(A) I, = Aa MA, A>O, 
引 理 2 WX? = limAg(A)1, W 


Xt + K =1， (13) 
weit 
其 中 Xi = Td OEH, (14) 
基 列 协调 族 
ACAD =O,(A)d,, GEH, k>0, (15) 
的 标准 映 象 ， 因 而 
| 六 看 (大 XP = X- MCAD, GOH, C1 


XERO KIERR. AT 


ADODO =E- A), A> 0a (179) 
Aki Hi Fe 
Hust, 
| (18) 
(iuil, 
R m 
因由 (大 7)X = X0, (19) 


FLX? By Re ( 18) hy ERIO m = UE eC. 

证 由 和) 的 预 解 方程 向 XX)(aEH) 是 列 协调 族 ， 其 标准 
tuk Se | 
X4 = mX; (A) = lim $;.(A)d, = Piadas (20) 


H(10.14), S PONSI, w > Xs, Ai hoe), 
eeN aH 


Hy (10.14) 016) 4 
MPO DX )=1- FLA), (21) 
u eH we lf 


FUL ROCA) A BR A XO) A> OFFI, AF XA) 
<1, MAS ERR <1, AmA. KAA 

MT OT) =0, ] 

GEXA 
BSA d OWIE DECS) AR, 


ARC 10.14), DKO) KCAL, 4A g AGOI} X°, 
Ei 


X=1- > X- X20, 


ae 
Hy C13). C17) 20210978119), ACAI BRE 
GAI- OJI =A (22) 
BAO X ALO. ÆEEAP GA 408X =0, M CAE 
(18>, RHA ECS HACA =u, Mi= AGAAGA, 故 
wk, EER, 


= jü * 


定义 3 FRY NSHONRAMAM, MA ERORA I 
TE AF 

引 理 3 (D 7A)A>0) 为 行 协 调 族 的 充 要 条件 是 有 下 列 前 
Riesz4} f, : 


nth) =abth) + BOA). | (23) 
HPTR Be>So By OAD A> offiad( Adc EEN 
la, 1- SX) ~ KA) |<, (24) 
wes 
m (AC STEARIC 7 (A) CAE REE; 
TONI- Q) =a, (25) 
WAILO, Anche, (A+ oo), (26) 


(ii) ECA) A> OA PUD DAA EEE FE A F y] Riesz 
Sy HF 
EMI =GAIB+ EA), | (27) 
APR ESERE Amu A> Ob(A) BC am, iy 
SA) € MUZE IIR. BATT SAD HEC ME Bee —" 
(AI ~ EO) = 8, | (28) 
Ech TO, AGCA)~B, (AF oo), | (29) 
WE BEC), HED. AAA), A>ORAHAR, & 
SHES O, ADO. # 
Av) + (Vv ADISA) = 1A) 20, 
HCV) == VOMNP OCA), 


NAV PN NA) S mlb) 
-A ldd, 


vn v= 1 vA D Bi OMAGA) ~ ~ 6,1, 


LAA RA, MISE, RK OO) HOFFE 
YEE S |B. 4A cof 
Vy CV) SS > (Va; 


+ dy * 


Fe FF EA PROSE AHR Aei 

ncv) (vI- Q)=alyv), (30) 
fk S1FH10.2, nO ae(we(v), Ma ov) € E—-Yv> om, 
RFOA AFA, MERI ATR, Kapone, RA 


ap(v) (VI —- QO) =a, (31) 
于 是 

EV sacvjo + Ftv), (32) 
KAP VC Hl, ARRAY, AD, ERODE), BH 

nA) = av) ba) + PvA, A), (33) 


Ral. d, FWA, EI。 将 (33) 代 入 (30) 并 注意 (31) 
得 eCY) =a), Me =a, MAAN, DTA). 
K, (82958023), HPF MR Eeihana 
R CEJ, A> DETUR. H3 ) 及 (25}) 得 (26) 第 一 
R. HEEB ikem, AAD pessoo BHAA HB 
性 证 气 。 死 分 性 是 明显 的 。 
fERECHID. HECE), AD>O) FEI IAI. 注意 (2.6)， 对 任意 
v>0, ARE 
B(v = (VI -OyE(v) | (34) 
BAT AAA. HIF (2.6) OO) MBSR EE, 
(VE ~ QE) = (VI - QI + A- v)6(V) 160) } 
={(vI-Q)[T+ (VE CV) JE) 
=v- Q+ (A-Y) 
= (AI-Q)E(A), 
RBA) = BRAS OFC, Ai(28) wea. 由 (3) 及 (28) 得 (29) 第 
一 式 。 由 此 及 控制 收 黎 定理 ， 在 (3238) 中 令 X-=ce 得 (29) 第 二 式 . 因 
EA) 0， 故 (29) 中 第 一 式 的 极限 8>>0。 依 引 理 10.3， 从 (38) 得 
EvViSenns, Aid ec 有 对 一 切 v omar, fy OCA) 的 8 条 
ee, MERE MS BB, ABbwscm, Ra 
(vWi-O)6(v) B= A, (35) 
于 是 由 上 式 , . (28) 及 引 理 10.2， 


* 42 + 


Evy = VIB+ Ee), (38) 
sirpi(v) Cai, SB EMAC, DOPER DACO, 4 
ECA) = GCA) Bt AV, AIS), 
He EQ) = ACY, 4) EW), ATC EA), ADO TIEN. 必要 性 
Est. Fis; PERE HAIR. E, 


BR Atek, 
XOY 40, AX OA )—ðuda ER, C37) 
Xto, AXAD, (38) 
引 还 4 BaO), APHORAMAK, MM 
g’ = MAA Keam, BASOEK, (39) 


WREG) A>OFF/ EHA, JF RAE REC e, i 
CAIN, EC] =ALHA), EJ- REME), 6], D 


ACRA), ELF Voce, (41) 
PR, ac Hij 

Vi AJGA X] $ Veo, (42) 
其 中 

VeaVirt+ nud, Guar, (43) 
JOST IRN), A> OR ER An., 

Cats), €1=C€4, 6A], (44) 
WEE, X<, Hj 

Cy, X°]=0. (45) 


证 (27) EE, 
RENCA), EJ=ACNCEA C, AD, Š] 
=ACNCE), Alp, AJEJ 
=ACNGE, 1+ CASEN), AGA] 
=A AEM), 614+ Ch~ WEA, EEG] 
=EN, EJH A-MEN, EA] (46) 
由 此 得 (40)， 从 而 得 (41)， 类 似 地 ， 利 用 届 9) 可 得 o" 与 % 无 关 ， 
MacH, EGO =X AH, UDA 
Va tA RENH), XA). (47) 


. jj >» 


AyaxX*aA<d, ROI RRA as Bw, 
Tati, AXA} lp do Atco, aCH, (48) 
PS fd fe C47 > Fs Sh co 9 42) (43, 
M u DRT, 
(A TNC), EOTS ACACA), EUH J-REN), EHO] 
ANCA), Ej. 
Hit, EUDP Auot | 
Onie), &J-~0, ihat, (487) 
MTE (40) FI Sh R C44), 
H(39), Win, X°]<co, i 
g SAn X° lO, S4A>oOR, 
to’ =6, DnA), X*]=0, 444-078-645), iS. 
51S MROAAS, W | 


ASX (A) rd Aco, (49) 
ace Fe . 


证 BZA = 1~AGA)E= D XA) + XA, 


RBOI- O20) = 4, We GHB AZAD od, th (38 49), 


引 理 6 WEEE Be hod (A) = OC MIT eS, 2, Gi$: A) = 
0， 且 级 数 钨 对 收效 )， 则 < = 0， 
如 果 列 矢量 8 使 6(%)8= 0{ 即 对 每 个 i S6:508)= 0, SLB 


By He HU RY), WB= oO, 
证 AOD ER Rea, He 


A; {A} = dit Y iPr (AD. : (50) 
È 


固定 i。 两 边 乘 B8; 并 对 j 求 和 得 
0= 8+ > > dishes) By 


* df * 


= 8; + = asl > r By } = Bi, 
求 和 号 可 以 交换 是 由 于 
之 之， SB87 | = ) 之 1P | (2 bd) 


= > | B; | ( D> diha (A) + 24i$i; Ch) ) 


= > | By | {bs (th) — Oy + 2qi0;, CA) } 
<= (A + 243) D bis) [B| Zc, 
Re FCA) PSE EE 
AD; (A) = Or + > Di, CAI py (52) 
EK 


奖 伺 可 证 8 =0， 证 举 。 


§ 12.，Q 过 程 的 一 般 形 式 


BHO) EF), WA) 一 和 以 ) 守 0。， 由 于 入 ) 满 足 向 后 不 
RG. IOAR (8.12), MOA MBA, w OA- OLUA) 
-$A)]20, WHYAICE~ANS Swear, MAWE, HAE 
B= 0,04) —6:,4) E 


一 Y ditt, = Fi (A), | (1) 
A 
FPF IA) 0, dpi Pe. 9] 10.2, 
BiA) = WA) — 67) > eh) EFS (A) 0, 
“AREA BO) Cw). 这样 我 们 得 到 下 面 的 定理 的 前 一 


部 分 . 
定理 1 ERLE E (2) 必 有 具有 下 面 形式 ， 


+ 45 * 


i CH) = 06,0.) + SX OFO) + BCA), (2) 


ao 
FOX A= ¢.0d(GEH), 4B, OMB (4) C8, 4 j jH 
定时 , BOE #i(--), 而 


Eeh) 20, ALFA), Lisl, «CH, (3) 
WR tO A) 满足 向 后 方程 组 ， 且 O 非 保 守 ， 则 FA) =0 
(ae), 
WARGO TA BAA, U4 se, Be CAC ei. it 
A ROFRR A, MFA) EC ey GEH), : 
WE BHEE, yA) CE, RPA) ER GEH), BADGE, 
mPOA) HEME, BO 非 保 守 ， 由 定理 8,4， 


APN) = D bud F O) =0， 由 引 理 11.6， 这 等 价 于 


FrA)=0 CoeEH). 
WOO WEA MARA, WHF VAM OO) 都 满足 F 条 
46, RMA) ={ Fi}, FCF), Wy 
(PAGO) + BCA} CAT ~ QO) = 9, 
ERM- O78 | | 
GA)(AT-@) =0, i 
Mm BAOQI-Q@)=0, BRASH, BAC et, FE #t 
(ach), | 
往 证 ( 3 )。 在 第 六 章 第 18 节 也 将 证 明 ( 3 )。 这 里 给 出 另 一 证 
HA, 
7E(2) EBA -OAH RA 


(AL --Q)(APCA)I=h+ S ud ACFA), 11. (4) 
当 i= aht, 

KAF- OMAPAYI) = + GALA, 11, (5) 
{A Ze C7. DAUL eS he HE UY 4S 


° 46° 


(MAT OFM <UL +d, (6) 
H5). (ORG), EH, 
定理 2 每 个 QQ 过 程 8CN)E .9 ,(Q}) 必 具有 下 面 形 让 ， 


Big) = 500) + DS BAO A) + CUR), (7) 
k 


其 中 有 HOW) = {H(A} COA) = {CG0 “i eR. 
Ci, (AVC ET, 当 ; 画 定时 ， C.G Ecm, HA) ER. 
POWE M A A EAHA R E: HGA Ei, C.A) 


Eat (5-). 


PCA) Te EAS AER AEE. HAD = 0。 
证 AFCO AI AS RAS. LI ROA PAE. 
LECA) P(A) HAT-O)} = HOA) SO, 
ie ey 5110.2, 
CA) =A) — O(4) 一 HOA) OCA) SO, 
且 Ci,(A)E HI， 从 而 得 (7)。 由 (7) 得 CC) Cm, Al 
H aCA EAn Ol, 
WH, Em, 
$A) RUBS BAS HF 
CAL- OOLA (ADGA) + CCAD] = 0. 
BORER CAl-O >) BM CAI-@Q HCA )D=0, 从 而 出 上 式 得 
OL-Q)CO) =0。 因 此 B 条 件 等 价 于 C.X)E I(E) HO) 
Cat, | 
4() 的 P 条 件 等 价 于 
LH{A OCA) + CLAD TCAT- 0) =0, 
BPH(A)=0, EZ. 
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第 二 革 ”简单 情形 的 Q 过 程 的 构造 


ll 


§1. 5| 


构造 8 过程 的 许多 文献 ， 如 Reuter[2],Feller[10],Doob[1]， 
Chungl2i, Williams i] AH I4 f L11 中 都 假定 ORY, 因为 此 
时 任何 过 程 都 满足 洁 后 方程 组 。 对 于 非 避 守 的 8, 只 有 少量 文献 
例如 ReuterL31，Feller[ 51， 利 杨 问 群 [2] 中 有 所 和 涉及。 如 果 上 只 构 
造 满足 向 后 方程 组 的 8 过 程 ,原由 上 可 以 按 定 理 1.7,7 化 为 保守 的 
情形 ， 得 不 是 直接 的 攀 造 。 而 且 这 种 杖 法 不 适用 于 满足 阿 前 方程 
组 的 总 过 程 。 

ERRE EBAREN ERRE, PEBE O RF. 
HORTA, Reuterl2] RAHATA 过 程 。 对 于 非 保 
FEO, Reuter(3] 中 构造 了 一 类 不 水 足 朵 后 方程 组 的 不 中 新 前 台 
WHE. $2 中 对 单 流出 时 直 败 构造 了 满 是 向 后 方程 组 的 全 部 吕 过 
程 ，33 中 对 非 保 守 的 & 构 造 了 一 类 包含 Reuterf-3] 中 结果 的 过 程 ， 
特别 ， 当 错 单 非 保守 零 流出 时 ， 我 们 构造 了 全 部 昌 过 程 。$ 4 中 对 
tee Pa ABS, BT EA AWS RO 过 程 。 
Ay BS 2 RL RLL | 


$ 2， 单 流出 时 满足 向 后 方程 组 的 Q 过程 的 构造 


由 引 理 1.10.4， 方 程 组 
+ dg + 


(AI-~Q)u=0, 
OEH E HE, 
HERAA a Sin Ae, emt = 0 即 i RS En, 
BOA SR. mt = 1 时 ， 称 O 为 单 流出 的 ， 当 m+ 有 限时 ， 
称 旬 为 有 限 流 出 的 ， 
(ASE O SoH. PAY] HA1.10.6, MOA) 20, Aye FE1.10.5, 
Be AEOCA) 中 肠 。 册 定理 1.12.1， 每 个 满足 向 后方 程 组 的 Q 过 
EVARA PER: 
30h) = POO + KAP, (A), (2) 
RIEM > OR SEP, WEFO NE YOE a ADARE, BI 
VON PURE, WHE. MAATA ERAO), BRE 
是 恒 满 足 的 ， 
定理 1 Hmo. AIEO) 确定 的 tx) 是 怠 过 程 的 充分 必要 
条 忻 是 ， 或 者 六 (入) = GA), RHA) Tareas, RAK He 
otep EE, WEARI 5 Ht, IPA 


C1) 


NA) =ad(h) +9(A) 250, (3) 
He Hf Bice E 
Cæ, X*j4r°+ > To, XI+P ee, CAY 


FOR’, X, AGH) Ay a). 11. 2H, F 


Soma H(A), Koo HAG, (5) 

Vi = ALNA), Xel Veco, Atco, aH, (6) 

Ve=Vi4+n,(ad, GA, (7) 

BOs CA) : 
D ta j(0) + 150) 
MTR O 
e+(a,¥-XKCA)I+4L AA), XI 

IRVA) BBG A FE SR, 

ORFA He, X'+ =e, (9) 


TRIO Ei RHA. SAGEM Ae eae 
| Fhe = 0, 

am’ -= lh, KROSS Rea eA Ox 
fe, SORA Hm’ = 1 时， 上 面 的 过 程 已 穷尽 一 切 恕 过程。 

证 由 OCA) 的 最 沙 性 ， yos 等 价 于 了 0) 之 0。 注意 
(1.10.14), FEA BaF 


F(A)>0, X(ADALFQA) 1I< FCA) + S XA), (10) 
g È Ti 
HF (1.10.14), 


DV X(A=GA)d= ST] OO dQ. (tll) 
a- @ - 


故 [Io xa) = 5 [] OOI +g) d>, 
nec, | C12) 
在 (10) 中 左 乘 T (*%) 并 取 极 限 得 


X(ADALF(A), 11 X(A), 
故 kLE 人 7，1] 委 1。 国 此 范 条 件 等 价 于 


F(x} =0, ALF), 1181, (13) 
OCA) 7B FB DBT BY Se SE ae 
OP TFIE HALF(A), LI=1, (14) 


HOO) EHR E., BIODRA IRAE, ERAO, 
FEF I, BVA) a eS tht F 
FOAJACA, B)= {14 (HA) PCA), AMIJE). 
(15) 
Be HyFC1.10.10), BACH, DARE, CODAT 
P(A) = 11+ (e-ADL PAD, XCF CAC, AD, 
: C16) 
WRES, Fi) = 0。 则 由 上 式 知 对 一 招生 0。F(%) = 
0。 国 而 Wh》= 和 (六)。 


+ Ai e 


Fl, eee 0, FeO, H PACEA), AOD ISALPOAD, 
<1, MB 1+( w-AMFCA), XCHI>0. 由 (16》 WA 
FC uA, A) 26, Ak, SRR — A >00, WC A = 
FA, DOBAH. BO, GDS TF 


FA) =m, q(0), mid, MA) * 0, (17) 
Abs Bin ee 
mom, mn ADMa, (18) 


EAER, BEY[FH1.11.3, nO ApRieszwMW (3), 
£18) FG it BR Umm, ig 
m! =m! tln ~An), XC), (19) 
但 由 (1.11,40)， 
(ROADWAY, XCM I = ERENCE KI ANO, XI, 


(20) 
因而 (19) 成 为 
mzi!—A[y(A), Xl=e (FH). (21) 
Pik ey (1.11.17), | 
Wi» = 1 = 
etC), XY] ct+aAlaeb(ay XI ALAC), XZ | 
- A (22) 
e+[@a,X —~XCAII+A4C nA] 
WA (18)—(22) hy eS EE A, 
WECL7 (2240. A0139) 49 
ALW(A}, 1-X ce, (23) 


{A (2.11.13), €1,.11.16)—(C1.11.19) R 3[B1.11.4, 
RECA), 1 -X1=ALeG(A), 1 ~ XI +A NA) 1-3 
= ALab(h),X° + D XIADA), X? + DS Xe] 
=De, Ad AX? + SX )]+a°+ SVG 
s gH ait 
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= [以 四 二 不" + S (Le, X- Xa) 


aca 
tLe, XJ+ + Sle, X40, 0, (24) 


最 后 一 步 是 由 于 (1.11.37)。 因 此 范 条 忻 (23) 成 为 (4)。 而 (14? 成 
ANC), PAL- EROF SRE RACH RES HAH 0, 定理 
其 他 结论 明显 ， 证 毕 。 

在 定理 1 的 证 明 中 ， 恕 果 在 (2) 中 用 方程 (1.10.15} 的 非 零 列 
协调 族 解 s 疏 ) 代 替 全 (%)， 稍 作 和 修改， 定理 仍然 有 产 、 Wit T E 
有 定理 2， 

TE? fem > oO, FCA) EAI1(1) 是 非 零 列 协调 族 , SHEA) 
fry tp HEM g, supg;(A)= 1, 为 使 


Bish) = pi + BCD EAD (25) 
确定 的 PCT) HAARE: RE VAPA), RA 
eA) 可 如 下 得 到 :到 行 猴 是 ws0 使 xsg(X) EE, REHA 04) 
EFi, GRIME 

fa, X~ F< Wi SMAA), -l W<oco, 
Af oo, (26) 
取 常 数 c 满 足 
Ce, X°]+7°+fe, F-€]+W+ D Cla, XF 


acit 


<¢ (27) 
其 中 记号 同 定 理 1。 最 后 令 


DS ane (A) +7; (A) 
HCA) =O; (A) + Ea umea 


cetie,- EAIA), S] 


(28) 
MYA UE ASR. SRE PRE RE 
ORF, $A)=X(4), Ca, X*]+7=¢ (29) 
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§3. 单 非 保守 零 流 出 时 Q 过 程 的 构造 


假定 8 非 保守 ， 并 且 


ZN = DS) KCK + XA), (1) 
ugeH 
BAR, ZA) REABZS DATE, FRET AR 
Z= X14 KN =1-X?, (2) 
RTE A) 
Pish) = pia CA) + ZOE (A) (3) 


确定 的 WA) CFO FEMA, HF ZAC ai, BBR 
上 成立。 因而 我 们 需要 考虑 范 条 性 、 预 解 方 程 和 8 条 你 ， 

EEL AEAEE PO) 是非 最 小 8 SEAR 
CA) 订 以 如 下 得 到 RARE ao Fedak, ROBIE 
nA) 已 i， 并 且 (2.3) 成 立 ， 还 应 满足 


[a, Z2])+Uso0o, Rel, | (4) 
或 等 价 地 

[¢, 11+ Y=, neyo, (5) 
Hey Uy s=ALHOAD, ZI] AU, Af oo, (6) 

Yi, =AL), 11+ ¥, At ow, (7) 
BR HE Biche JE 

fa, XJ ple, - (8) 


其 中 5 加 (3.5)， 最 后 令 


SsbA) + CA) 


Plo = bX) + Z, (A) —_—_-_____—_______—__, 
e+[a,Z—-Z(A) T+ LN) Z] 


49) 
MELOOR RA RAHBA, TARR EAHA 


#457 >» 


c=0, DEVO) A PRR BRE 
fe, X°]+o°=e, (10) 
TE 人 芒 定 理 2.1， 为 使 范 条 件 及 预 解 方 程 成 立 ， 必 须 而 且 只 
需 (2.17) 成 立 ， 其 中 ?hk) 有 表现 (2.3)》， 太 :由 (人 2.22)5 用 忆 ,ZCA) 
RER RHI, XO) ) 确 定 。 代 入 范 条 性 2.13) 得 
RENCA), 1~Z]<c (11) 
fH ALy(AD, 1-Z]=ALH(AD, X°]=Lae, X']+ g’, 


(12> 
HODR). 
为 使 (9 中 的 #(x ) 是 如 过 程 ， 尚 需 验证 @ 条 件 ， 即 
。 Mm) — x 
lim A Zi(A) FFAN, ZI 1E (123) 


注意 民 .11.38)， 从 (2) 及 引 理 1.31.5 得 
AZ (A) di (Aco), GD 


H31.11.3, MMO )—>=0, MFA) 1 0, W 


ALACA), Zl=La, Z-Z) J+A O), Z] 
tle, Z]+U, Ato, (15) 
于 是 上 4143 成 为 


di see, Hae ~ 
而 这 等 价 于 4。 由 工 = 工 ~ 区 0， 而 由 人 .11.39)， 

or =M), X*] Sle, X°]+o%<o, (17) 
ADHD it, IEE. 

由 引 理 1.10.4， 方 程 

vAI-Q)=0, 

O=vc £, | 
AMES ot 的 维 数 对 与 和 无关。 当 = OW, RER 2 是 零 流入 
a. “int = 1 时 ， 称 搜 阵 @ 是 单 流 入 的 ， 当 人 有 限时 ， 称 矩阵 品 荐 
有 有限 流入 的 。 
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0. C16) 


(18) 


RO ROFECESE ASB SHA. MEER EE Re = 利 非 零 行 协 
WINGO) E .gr1。 因 而 定理 1 中 的 非 最 小 过程) 是 存在 的 . 

如 果 电 非 保守 和 且 堆 流入，。 则 为 使 定理 1 中 的 非 最 小 过 程 #(%) 
FE, WAM HAR: Erie) CF, Ale, 1]=-, if 
RG PA REB, S112. 2. 4D 给 
H. 

引 理 2 FEe>tttet0) 所 而 LEw&，1] = ee 的 充 要 条 He 是 对 
FEA OME EDAD oO, 


infh 2 $3,044) =0, (19) 
证 设 存在 x>0 使 对 某 个 和 汪 0 有 a$) CEALe, 1J=co, 由 


P(A) AY PR EE Red (A) € ERT — WA > One. AF 
ALCa@(A), 1] =Le, Ad(A)1] 


>Le, Ljinfh DuA), 
i 
RL C1S Xt — BAD ORR. 
HEODEZ. HAt o>, em A D uO >0, 于 是 从 


C19) 推 出 ， 存在 互 不 相同 的 i EE, K=1, 2, 3, {E 
DOMOS 


gi 
取 
gf ’ AME ts fas ja 
0, miei, Vas sos} 
出 
Map), 1]=Ca, APCIII< Zyl, 
=i 
[e,1]= Dt = > L=, 
k-i imi 
HAET., 


=+ 35° 


HE (1G) AEG 


SupZ;(*) =}, (20) 
WRK (A) +O, We 5] 1.10.7, 
supX) =1, {21) 
Kia (20) BEM. 
MEX CAD =0, C20) RA 
sup ZX =1. (22) 
Wm RORMARR SS, HHA S—~P+jkeee, MDAA 
supXf(Ad=1, . (23) 
或 等 价 地 
supo: a A) = 7 (24) 
定理 3 HOPRMH., HRE ARRAES. ER} 
Zith) = $;,(0)d,, Zi= Tied El, (25) 


其 中 工 由 (1.10.87 确 定 。 如 果 总 零 流 入 ， 且 
SUPO CA) <p 
出 8 过 程 叭 一 ， | 
WEOE SHA. RA OSRAH (24) WE. MOLE 不 唯 
—. DEES PSE RO ie BT 按 定 理 1 方式 得 到 ， 


§ 4， 单 流入 时 满足 向 前 方程 组 的 Q 过 程 的 构造 
本 节 不 要 求 怠 保守， 但 假定 最 小 解 中 W mA n >o, ERT 
可 以 选取 非 零 前 行 协调 族 1 人 ) E ,如果 怠 过 程 yA) A ABA: 
POEA + FA) 0), (1) 


DISA) BEAD BA. RS, We =1， 则 任意 满足 向 前 方 
FAA Os Fy (Ae AL). RIRE >>0 的 条 入 下 ， 
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WASP) HO) PAYA) BOW. 由 于 F 条 性 人 恒 满 足 ， 因 此 我 们 
只 需 考察 范 条 忻 和 预 解 方程 。 | 

EE BREGO DPE, nt> 0 ,为 使 (1) 确 定 的 CX) 是 
人 过程 的 充 要 条 性 是 ， MAYA) = OFA) RAV AL a PP Bal, 
Rae d= 0 RIBARA TOA cAi, Eiet, A 
果 9> 0 MERR Esu A) =1, WR FRF, MEET 


cEH, RRE Poem, WHERE 
aiff 


ECA) = > XA) + dF (A) 40, (2) 
ged 
及 
ALM (A), E]<oo, } (3) 
Ws AL mA), %~ OF] 4 Woo, Ato, 
其 中 
E= Sl PX + dE , | 
ail FF (4) 
k= inffi, d a? acH } 
取 常 数 6 满足 
°+W+ Sake Vake, (5) 


Hope, PHO D2. NRE. BAS 
(DS BK F(A) +E (A) ) AA) 


aca 


Bis (Ad = ta) + — c amamma 
c+ E EMIA), Ks]+ OAL na), ËJ 


(6) 
PEAR HAREA PPE 
E=, P=d(aCH), c=’, (7) 
1 
i? Wie = 
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RYO) HEE RHA, ENOO REM RAE oR 
SPB A= 0C¢CH), Yat = 1 时 ， 上 面 得 到 的 过 程 已 穷尽 了 满足 
加 前 方程 组 的 全 部 过 程 ， 

证 由 (1.10.14)， 范 条 性 等 价 于 


OSFA), FOM nA), 1] < E X*A) + KA), 


类 位 (2.,15)， 预 解 方 程 等 价 于 8 
Ale, DE = FA) + (A= pE OOI), FOI, 
(9) 
或 等 价 地 
F(w) = {1+ CALI A), FODA, WFO), 
(10) 
HOSEA > OFFA) = ON —- BA > OFA) =0, Efe) = 
pO). BMW C0 SF 


F(A) =m, EA), mi> 0, ECA) 40, (11) 
其 中 数量 m, > Oe l 

m, =mi {1+ A DEn A), EGO TIM, Y. (12) 
而 EEC) 是 非 零 列 协调 族 。 依 引 理 1,11.3，&(%) 有 Riesz 表 现 

ECA) = $A)B+ ENEN (13) - 


其 中 列 矢量 8 二 0 使 9%)BEm， 列 协调 族 5 COC wt. AMIE 
1.10.4 和 1.10.7， 易 证 6 = sup GO) 与 :>0 无 关 , 如 0= 0 . 令 ECN) = 
0; 如 00， 冷 ED) =67 EA), MCE), A> 0) EF HARK, 
设 其 标 淮 映 象 为 6， 于 是 
sup§(4)=1, 可 6>0。 | (14) 
比较 (1.12.2) 便 得 B;= 0( EE-E), eee = Bae He, (13) 
成 为 | 
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E(A) = D PXA) + OLE) FO, | (15) 


HERRY 
E= > px1+d6F+ 0, (16) 


ach 


fE VEAL 9 (A), Elco, AMR, EODH Umm Be 


mi! =m! + (A-LA), EGO], 
Su 0 得 


my i> lim ~ ET CA), EW]=AL N (A), £1= co， 


从 而 mi = 0 ， 此 与 (11) 巴 盾 ， 
FFA (1. 11,40), 


(B-MDNA), EG) <ul nw, E]-AL AA), EJ. 


(17) 
WEC12) PRB em, Ae, PEER Bec He 


mi=(ethAC HA), £D, (18) 
将 (11)(15) 代 入 (1) 后 与 (1.12.32) 比 较 得 P(A) = Bm HO), 
注意 (1.12.3}, 有 


Bm AL (A), 11<1, «CH, (19) 
特 (15)(11) 代 入 范 条 性 (8}) 得 
( DEXA) + GEA) ACH A), 1 SKA) + KA), 
aed sEH 
(20) 
EKA HHHH") FP Seno, ER. 
O OOMAI), 11 KA), (21) 
TEIR, TA C20) BHF 19) (21), 
HODE 
ËL) (22) 
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得 (21) 等 价 于 l 
Ôm ACN (A), 1121. (23) 


TH, PRH C21) (19) 成 为 
MANOA), Ek, (24) 


HPD’, akao, BCISD CISPR A (249% 


AL 1 (A), KO] + SAL WA), XIHA WA), XI 


ae 


<ketk D OA Ch), XJ+ KOMAA), 21, 


ae 


即 r+ Wr > 1 ke OP ike, (25) 
acy 


Ah} coFF RH SMF). 

WEAR HE, Hmn LAR -S BN C21) 
(19) 成 立 等 导 。 从 而 P=d(ecH), FA)=XA3, PE=X. A 
而 =O!。，(5) 中 等 号 成 为 ?= 0!1C， KRY PRN BER 
FECT). ERRERA EIT, EE. 
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第 三 章 ”唯一 性 问题 


§1. 引 & 


给 定 吕 满足 (1.2.6)， 吕 过 程 总 是 存在 的 。 本 童 讨论 唯一 性 问 
题 。32 中 给 出 了 满足 向 语 方 程 组 的 过 程 唯 一 的 充 要 条 HY. $3 
中 给 出 了 满足 多 前 方程 组 前 Q@ 过 程 唯一 的 充 要 和 条件。 这 两 节 的 内 
Fi Reuteri]. $ 4h APREA (Reuter) eH, Bl Code 
BE — PE HEMI AEH, Hk GB Reuter[4], RE ET Be ee. 
Ble, Eie Ay He — PE fal A 5 RR 


$ 2. 唯一 性 定理 : 向 后 方程 组 


演 计 请 足 门 后 方 竹 组 的 8 过 程 KERE, 方程 

(U) hu—Qu=ġ, (1) 
将 起 很 大 的 任用。 回忆 方程 (U， ) 的 解 u an hy EI a EH 
ffiu Came fkipyy it, Mm RAAK SIA eK), i ae 
数 记 为 让”。 

定理 1 FAAR.: 

(i) HERAT BANCO ER, 

、 GD AAAS OOM — OAS O), Ms Ree NE. 

(ii) ADOC MMW EAS, wiih See. 

如 果 上 面 的 一 个 条 件 不 成 立 ， 网 有 无 穷 多 个 台 过 程 WES 
FRA, WHORE. WELASI HOT AIA 
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AER SRO YS, WD Re TRACOM eA 
ITA. 

ME, (=> (11>, BCH) A an, S/H 10.6, FA) AO. 在 
(2.2.8) PRIA) =0, e=@, Ce, 1)=1, e= Le," 而 得 的 过 
Ree (A i EUR RSA. WROT, REATO 还 是 不 中 断 的 ， 
(Hen GEA ASSH, Ama, ee Ci) Bear. 

(i= Ci) AN AHE, FERECHD> (i), Ril) or. Al XO) 
E4401), RXA=0. HFXKABADAIR, wA A> 0 
AXA) =66。 如 来 #(%) 满 足 向 后 方程 组 , 依 定理 1.12.1,(1.12.2) 
中 的 PCN) = 0 EH), 而 当 j 固定 时 Wi= ABAE ACD. 由 
XA) A EAB, OD F(A), HB) = =0. AAMC1.12.2) 成 
AOA) = PCA). WEO, 

OR BANS AN Oat ee A) EA A WN AE OO) 的 B 
PP BAP ORAM BOR, wen. 


§3. 唯一 性 定理 向 前 方程 组 


. 考虑 满足 向 前 方程 组 的 @ 过 程 的 唯一 性 问题 时 ， 方程 组 
(Vi) Av~oQ=0 (1) 
将 起 很 大 的 作用 。 回 记 方程 人 Re CEM eK 1, JER 
fee EC 的 全 体 记 为 1。 名 ?的 维 数 记 为 n 
定理 1 GMA BMRA TE BR Rh Bran” = 0, 
Mpe RLS) Be FE EA Or EER. | 
GD 加 果 最 小 解 中 断 且 #* =1, WELAIST 8 过 程 满足 同 
前 方程 组 ,其 中 只 有 一 个 是 不 中 断 的 ， 
Gi PERMA hi, Be >>1， 则 有 无 穷 多 个 OW ER 
向 前 方程 组 ， 其 中 有 无 穿 多 个 是 林 中 断 的 。 
证 D 最 小 解 不 中 断 时 ， 趴 一 性 显然 、 设 最 小 解 中 汤 且 
二 0。 录 果 #(x) 是 满足 向 前 方程 组 的 名 过 程 ， 电 定理 1.12.1， 
(1.12.2) APA) E FI CGEH), u= BAC 271, BRA) =g 
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(EH), Buso, (1.12.20 dA = O10), BI EHAA 
EHHO, 

Gi) 定理 2.4.1 已 给 出 档 造 性 证 明 。 

(iii) 前 一 部 分 已 由 定理 2.4.1 回 管 。 因 为 他 >1， 衣 可 以 选 
FHR POD E et(a=1,2), Ea O), 4°04) 88 tE Dh, tE 
Ree Ss 0(a=1,2), fH 


mA) =p n A+ POOO, 


对 于 二 (%)， 按 定理 3.4.1， 存 在 一 个 不 中 断 的 8 过程 满足 向 前 方 
程 组 ， 但 可 以 有 无 并 多 种 方式 选取 pr"(a=1,2} 而 使 7 以 } 不 相隔 
(常数 因子 不 考 妃 )， 因 而 存在 无 穷 多 个 不 中 断 的 8 过程 满足 疝 前 
方程 组 ， 证 毕 。 


$4。 唯一 性 准则 ， 优 氢 手 一 芦 脱 (Reuter) 定 理 


Ost #2 Bo HE — HE HE) h BEL IIA, 并 已 总 结 于 他 的 局 
C1]. WAWEL, 2] PRES APL MAA EAE 一 性 
间 题 ， 即 所 谓 定 性 理学 .RervterLd4] 对 候 振 挎 [1] 的 证 滑 做 了 简化 ， 
这 里 采用 Rernter 的 篇 化 证 明 并 作 了 进一步 的 改进 . 

定理 ! 设 结 定 叫 阵 台 满足 41.2.6)?。 则 如 过 程 唯一 的 充 要 条 
性 是 最 小 品 过 程 所 (不 中 断 ， 或 者 最 小 @ 过 程 中 断 并 满足 下 面 两 
A) Sf FE 


(1) infh 之 isd) =q > 0, A>O, (1) 
į 
(ii) #7= 0, BAR VORA ERIE Hee FE, 


我 们 指出 ， ADRS =o, 
实际 上 ， 由 {人 ,10,14)，(1) 成 为 


sup{ DB X10) + XA) <12>0， {2) 
1 as H 


Msg CRD SORT, (1.10.21. AC2 ACAD =0, M mi 
a 63 # 


mrt= 0, 
RH. REONTSE R F: 
(i) m'=Ù0, 
(ii,) sup > padd 1, A>0, 
定理 的 证 明 AH, GEDORE E O a, M 
MEWO —, WEW., n0., SER 
infh DAA = 0, (3) 
53,2, Beep eMeS ole, =O BedQek, At ike, 
4K 52 FH2.3.1, 
sie, 3 (A) 
e+la,z—z2(A)] 


是 如 过 程 ， 其 中 2(4) =1~Ab(A)1 40, c=[a, X°], Ach ue 
RALPH. ROM RH, REDRE BRRR. 于 是 
D RE. - 

充分 性 BD GDR, HYR 8 jt, WG), RE 
理 1,12.1 中 的 ，BCA) = 0， 从 而 51.12.27 化 为 


big) = Oi) + DXO (A), (5) 


Yi AY = Gi, A tilh) (4) 


MBHYySaH, HEA $0)=¢O), AMON. FRA 
<6, 6 (5) ARRAY HE, ERINO EDR fe, 
MEH F31.11.6, XO), ac HREM, RNG 

Fe A SFR) + A SRA), X Et), 


bed 
scH, (6) 
因为 Fe(k) 0, MEA), 111, HERTAN, HER A, a 
0, FDA, DEE FRM e@aeRA>o, H (1.10.8), 90) 
= FAJA, DSO 是 行 协调 族 ， 依 引 理 1,11,3， 
n(n) = ab (pn) + WCB), 


a §4 * 


其 中 2 汪 0 与 无关， 使 a6 (1) CH, CnC), o>) WHEN. 
Gi), n*=0, Beye) =0， 又 出 于 a 与 8 及 和 有关， 前 = ath), 
PEL) = CH} 


FO ACA, P) = ar(h) b(n), (7) 
特别 地 ， 当 4 = 和 时 ， 
FPA) =e APA), o 
由 条 件 (i， 


ALA}, 卫 了 一 大 [esf 下 [六 7， 了 了 
= ACA), AELE Ce 1, 


lea), 11< a. (9) 


将 (8》 FLAC), FER (1.10.89 9/1.11.6, BNA 
(hk) =a) + (HA) DOA), PACH) Tar, 
Let 


(10) 
或 由 于 OA), ADO) 的 列 协调 性 省 


BAY =e7(u) + atch), XC) ~ abn) Jeb, 《117 


teat 


HCO, 7h) BARR TASH, EHE 
MURKY 10, Af oo, (12) 
hk, BFPO MOA) Be BORE. HD Rie 


lim SAXIA EAN GCN); = 0， 
一 名 ae ft 


Miia 
lim AX (Gar (ADAG, ,O) = 0, GCH, 
Ao} an 


HOCK) PURE SR F B 
od, lim a; (AIG, | = Da 


65° 


cy Aui, FACS), 
S Catia), KAU < D EA), Ko) tatu) 


fen bif 


<= Seu), Kt) S e), Xt a) 1 


beH eH 


<el), Sew S Lae), 1144 <o, 
bel Ya MWe 


因此 (11》 可 写成 
Ayt DCA), Xelipe y 


Red 


=Æ) t+ >) G), KOCK), Peds 
bc 


并 且 当 % 一 >co 时 ， 可 用 控制 收敛 定理 得 
0+ SCO, J = oC) + 之 [0， OIO, 


b- H 
Pr Rhea") =0la CH, poo), R, F(A) = OCG CH, ASO, 从 
Mpa = 和 (因而 如 过 程 是 唯一 的 。 和 定理 证 完 。 


oe A& ® 


第 一 篇 。 生 灭 过 程 构造 论 . 


为 了 进一步 研究 过 程 的 构造 论 ， 研 究 两 种 特殊 钓 过 程 即 双 这 
生 灭 过程 和 单 边 生 灭 过 程 的 构造 ,是 极其 有 益 的 .我 们 考 焉 的 双边 
RUBS, BUA KE ARATE SRA, MPRA 
竺 天 过 程 ， 其 解 空间 .#1 的 维 数 maz, MPRA Ke, R 
in" 志 1，、 且 司 能 有 一 个 非 保 守 状 态 ， 因 而 较 简单 而 窗 有 局 发 性 ， 
生 灭 过 程 之 所 以 重要 ， 是 因为 它们 有 很 重大 的 理论 意义 和 应 用 优 
值 。 对 生 灭 过 程 的 研究 不 羽 可 以 得 出 许多 丰富 而 深刻 的 结果 ， 面 
县 往往 是 产生 解决 一 般 过 程 的 问题 的 思想 和 方法 的 源泉 。 


第 四 章 ”双边 生 灭 过 程 


§1.5 5 


当 状 态 空间 为 ~- 切 整数 而 2 = (aig) RATIER 


t20, mli- >l, \ C1) 
Ji_ => Gig, =O 0, A = -dr =a: + b, 


时 ， 称 @ 过 程 为 双边 生 灭 过 程 。 本 章 中 ，& 过 程 企 指 双 边 生 Rit 
程 。 双 过 生 丈 过 程 是 保守 的 ， 因 而 必定 满足 亲 后 方 检 组。 

本 章 中 我 们 圆满 地 解 央 了 双边 生 灭 过程 的 构 进 问题 ,换言之 ， 
我 们 桔 造 了 全 部 双边 生 严 过 程 ， 我 们 视 双 边 生 灭 过 程 为 扩散 ， 使 
用 的 方法 是 分 析 方 法 ， 本 章 内 容 取 自 杨 阿 群 L6]。 
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$2. 自然 尺度 和 标准 测度 


XFO. D ERO, $ 


zie bo (1+2 Boren db) ) 
-1 aag by Gigt Gi) 
wo 
#35 -bo 20 = 0, Zi = ügy P 
— Fi Ga Gy erdi] 
Zi= Hy (1+5 + b. 十 ， BE ee ae ), | 
mi>t1. j 
(13 
A BRR, $ 
r= lim zi 7,= lim z, (2) 
| ee d-re 
d_i 3° "Oiti T 
BB ob be? Mic- | 
1 1 1 | 
= = = t 
H- Bo "ob Pi d,a,” L > 
6 b+ By, 
haan 1G; 4G; ” 如 i>1。 j 


为 标准 测度 . 
83. 边界 点 的 分 类 


通过 自然 尺度 和 标准 测度 可 以 将 边界 点 分 类 ， 称 边界 点 7, 为 
正则 Mr Ay. D eae ay; 


i>a 
流出 Mra JEE M, Br: A F, oa am 21 A, 
流入 ”如 果 r; 非 正 则 ， 但 可 zs 有 和 穷 
‘>a 
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1" Se fe ëF 


AR .其 它 情形 。 


RS 
R,= Szt = D (i) > Hj» 1 
Pad i<o payed 
S,=- D Zilli: 
fed ! 
E f 
R, = Sr, 2 > Ci — 2 > Hj» 
ipg i> ọ Gup ae 
5, = Y Zits 
.由 j 


m) R A SH, 可 得 r* 有 穷 ， aS ay SF BY HY FF ce 


I= Ẹ 


WEL ARAA 
正则 5ER R,<ic, doo 
mi SHRY R,<00, d= 00; 
mA ” 当 且 只 当 R,= co, 5,<coy 
自然 ” 当 且 只 当 R,=0, S,=0, 
证 对 r=8 凶 以 证 明 。 显 然 

R,«7, S His S&F; Si. 


it od 


C1) 


BUE ERAT ARIA EHR. SB RAR, MWAN. 


Ax Apr a IE MJ, MR, <ico, oo, 友之 ， 所 过 R, eam, Hs, oo 


AR Ae Merl Aa. 又 > Ha = ics, FR Ja, 
iü 2 


dR Rh, RER <oo, 之 由 = cc。 FAS, 2, 之 Hs 
而 得 3, =co, RZ, WER, S, 5,= se， 由 第 一 段 所 证 ，+, 非 


正则 ， TH HR, <o RRAN, 因此 r: 为 流出 。 


RORY iA, PREN Ss Ly LHF Fy SE TE Wl) A 33 — Beit 


HE, ER, = sco。 上 反之， 如 果 R, =, 5,<co, AB Er 所 证 


Po Jk E mu, Mir. HEA, 


69 = 


Hi EMBER, ac Bir. ERC RRR, = 2, 
S$, = 0, HEB 
$4. “M25 SF 
BRBEALELR WR, CMe AD. a Ks 
gta Mini Ti EB, 
flay 7 i 
于] 一 uy (1) 
CD, uti= ailn PEE, 
. Hi 
EE Ley) KBs, 
Ou= Dut, (3) 
BJ ai; , ~ Ca; + b) uz + Githa = (D (3) 
_ 1 
EO aga 
b; = 1 (4) 


3 
(Zia) 一 Zit 
Min Mi Mim Mi y 


Ke (Dut) = tie Ai AI Ft 
Hi 


= PC Mpg ~ H) e Gi id 
= Qija ~ ae bdh + Getter, 
ute, 
HreeA ARR. was) ee TRB, 反之 ， 如 BUA 
REE, URS RAT Re | 
定理 2 设 v 为 行 矢量，#=vh !， 风 
vQ = (Quy, | (5) 
证 注意 ow Fi ey = GiBi t = Oy, (63 
M) (Qu); = vi HFa ~ Cay +b; oT + bivi TAA 
Ubi 871 — (a; +O; ue +0; 4 4741 PG? 
= (ug. Di ~ Ui + 85) + Vig Sig EG? 


= (vO wet, 


eff * 


系 » THIRE, vi, 8= fe, Meee 


ef (7) 
或 Au-~Qu=f, A>0, (8) 
当 且 仪 当 vw 满足 
vQ = 8， (9) 
BR Av-vO=2, | (10) 


引 理 3 方程 组 
Wi = fi, } 
Grilh 1 ~ Cy + Oy tte t bette, = — Fa, ithe, ; 
un =f, ) 
的 解 是 


ay Eh ef 2 = 
u, = fi tt 下 一 一 : S (2; —2;)f su, 
二 一 全; 2 = 


+ T. 2 CETT (12) 


证 HEMI, 方程 (1 成 为 
“inti, 
ni ur = fm, i<ck<cn, | {13> 
tn = fan 
FY 


h 
uf =u] + ` (uf — ut.) = ` Fitts, 
Izit tsin] 
由 此 得 
| 


H= 十 2n 1 My) = My t Duta 


一 Hi 十 Su ce Lita ) Zei — 2) 


I-i 


T- 
和 一 1 二- 1 


= f+ uC, — 31) ~ > pe Zi}. 


| 有 


b- 1 
Hh uaF tule nz) 人 (24 一 2 hj, (14) 


imp + 


+ 77 里 


特别 当 = # 时 得 
T 一 上 
haofituilaczay-~ 《一 


forte 
ffi 1 S , 
yt oo = . Hl 
KIT ni 2 r ae ziii, (15) 


{HOUD RAGO FARM, MEE, 


§5. hu- Dou =0 的 解 
定理 1 u, vA 


hu~D,ut=0, ADO, (1) 
BIRIA AE. m 
Wu, vj=tto = uut = BR, (2) 


证 HAE, WERKE, t, 
Sifi St ti 58C tiS fini) + bb C8 Sii) 
= $7. Cfo 1) 
T LD, ct i= s: Dati t tia D,s)i 
= si 1(D, iht DS), (3) 
于 是 DW, v)=D,(utv)—D,(uv*) 
=uAD,u j tuf (Du) 
~ uD, vr v7. (Duu) 
= Auiti, tur Di AU FD, 


Hi Tn 
Z; > Zi-! Hi 


H Yi- a HT o 
Z= Zii tt; ° 


HED 本 以 改写 为 
up #0, C4) 


fein ase RCD ARR, WA yi ont, 


uj = uit DS (uy Hha) 
A 1l 


. 7? . 


f 


MPS UD HA i 0. (5) 


总 一 下 
i-i 
Ui = H+ D, (ten — He) 
k=a 
i—l 
=H, 十 SD) us (2541 — Ze), i>i, (6) 
A=0 
将 5} 代入 5) 式 并 整理 得 
i—i 
Uj = by + Uy (2;— Zo) +A D Wyle Zp) be, 
A=1 
i>o, (7) 
类 做 地 对 ;<0， 
-A > Uris, i<cod, (8) 
f+Ler-.g 


Hi = Ho u lzy zD +A © Ula Zidian 


i+1izAd 


Z0, (9) 
Wz, EAR Eu, vt, BHC. (6) MAES, vl, Na, ut, 
ot, FAT) Pew 1, Uži, Hass Ula, =e, BU, JAEN ERJ u 
是 方程 (1) 的 解 . 
给 定 so= 1, “=O, FAD MRA, Axx, =0, ui 
= 1 肘 ， 方 程 (1》 WWS. h <7)、(9》 看 出 ， 当 A<it + 
时 ，z 利 3 为 正 且 严格 增加 ， 当 0 -onm, nA -s AEE 
i 的 绝对 值 增加 而 严格 撤 机 。 而 且 由 定理 1， 
Wis, vi =sfu,-s,vg=l, (10) 


, + 
3182 “yi ont, <i>. 
i E 


ME sg: ost S87 “Sep ~ 

引 理 3 当 0<it + co 时 ， 一 :一 严格 减少 ， 
Vir ] 

证 (2) =- +] =): Pigg Z; 


. 73 >» 


_ Wis,v) 


Sidi; 


引 理 4。 当 0<it tont, Zii, 


+ + + 
Le D Za) = Ui Vi-y ) u7! 
K gr , gt gt i 
i i j=l 


Siati Siia 


<4. 


STS]. Hi 

~ 87_,(D,v");— vi a (Dasty 
SFSF- 

- A(s Ui UF 1S:) 

3STSE_ 

L LS 一 ASiDi (Ui ~ AUS: 
SSj] 

= AW (s, v) _ he >o 

sist] sist_, i 


引 理 5 ut DEC) WR, Bko<it +ont, uW EH 
严格 增加 。 则 0<it tool, utay u(r, = lim uoo 
4 AA r JE aH, wtr) = lim wi< oo 当 且 只 “ir. 正则 或 
IA. 

证 HR Ru >n ERE ee, 

设 ujac, H7 


int 
Us >A > (24 — Ze (11) 
k=1 


Mi + oot, WAAR, <oo, Bir, ENR. RZ, ER <o, 
HS), 


l i 
Mig CMI SH) + 2741-21) Dies, 


kal 


u ue 
Eth Ri 2) th Car 24) Die, 
U: Hy k= 1 


上 式 右 方 是 收 伍 级 数 的 项 ， 故 Sloe“ Wee, AN 


i-o 


Ümu < o, 


i 


«74 


Butir) cc, (7) uug. HoH), 
UISHI HUIA D Za, 
A=1 
HLS, <oo, Br. TE WU BR eA. 反之 ， ES, <co, Hy (6), 
HH FUT (2p ~ 2.) = by +u iiy 
We MT ~ MEL, = Aut; <A gy +A Zii» 


+ 
Hi 1< pu Aiha, 
Hii 


HS, cog Z m <o, fi EX ie BA 之 198 二 


HBC SE» A 


BIBS Yo<it + co 时 ， 
MUG 1 — _ Mir, 非 正 则 时 ， 
CO, war, 正则 时 。 


证 ” 电 引 理 2 和 引 理 5 推出 
内 引 理 2 至 4， 可 以 令 
6 = lim”, g = lim 24, (12) 
int oc $j i + Bi 
HEES, SAREM, 8 = 8. 

定理 7 «BHO PER fFe = LAER F ER 

BK BURA TIEA 

w=av—Os, (13) 
Hpecece, WR EN, PERRO ALAS, WAF 
u =p- Oslu =v- 8s 之 间 。 如 果 r: 非 正则 ， 则 上 述 解 & 是 唯 
一 的 ， 

wE Hrv, spi (D HPP REMI. Mite 
vs 的 线性 组 合 ， 从 而 满足 #。= 1 的 解 kK 区 共有 形式 《13) 。 

Bu ERA FER, Mesu- Bt =t- Gs > 0, 
keot, 反之, HP Kee ,MMBimoy,w,>0, wi<o, 
Blezei>OL WIE APT. 在 i<0 上 ， 由 于 "和 o 为 正 且 
“Omi, ont, Mi AIA Pee. heres FA iE 


e735 9? 


且 严 格 下 降 ， 证 毕 。 
引 理 8 Emr ppu, we Plu, 
0, ra Wi HEK EPR ian 
u(r, ) -f 


» FART 正则 时 下 (ro) = qi 


fo re WARE Ry EMm e+) = 0. 

utr, ) = 1 + 

i Sty? 流出; 正则 村 其 rs) = sr)’ 
证 ” 当 r, 流 出 或 正则 时 ， 由 引 理 5，vtrs) 之 co0， stfs) 之 00， 

Wu (ra) sure) =- Os(r,)=0, 4r JEN 时 ， 


U r JS re) — UT Or, sry) 
s*(r,) 


i 
s* (Fa) 


HW (F,) =V) = 0 Str,) = 


Wi =u, =0,~ ÔU, -Ys, =E, mR. H $R, WA 


si 
st(rz)= 00, $u) = u (r,})=0, WE 流入， 则 
u(r) = u (F, DERG" 


YERS, 当 i 充 分 大 时 
Hr + ey dsr。 


国定 一 个 记 当 并 守门 充分 大 时 ， 


uy | 
u(r) tev, -75i è 


i 


但 当 j 固 定时 ， 
vt 
(v2 s s) sul ist f= 2E ys <0, 
‘ Cr, ) te YU -Uis aa 
ih ' a | sj str)” 


HFR, “u(r, J) = rr )* Or Ar. JLAM, Kf) = 
Ape" Cr, ATURE A, BARS, IE, 
4 i6 * 


FED 


定理 9 E (D AFEERI TERR, OVALE BY i 
EFH, A), HA FYER: 
G) ut) <OFF RES, w ONSKER. 
BECAN, CA) =u, buts 1, ADO, (14) 
(ii) alfas 4) Slim wa: AA 34 A AME ek pi Hy 


Bra A)=lim ut, CO), RÆ ft D the ADB: Soo, 4B 


AS IEW RRA. 

(iii) 站 果 产 非 流入 ， 则 (rm，x =0 (Aa), AURA 或 
AAR, Mui, à) =0(64a), 

证 ”根据 定理 7， 方 程 〈1) 的 正 的 严格 下 降解 上 Cu) E. 
Hh, TEA Pee ROAR OBEE. MA G 和 《8) 可 见 ， 
Wico CAD ORR PPR LI. BSW, AD, 8, CAD) > O, 
适当 规范 后 ， 可 使 (14》 满 是 ， 

对 a= 2 ERR GIJ, Gii, h 3 5f cdi, M 

AT a, (AR, SUT, AJ- ui’ AD, (15) 


BARU Oo MAM, BU ME tr F Eu, Ous 


<oo, W58, WLR Ae, CAREC), HE B, 
EWI u (ADAYA A FE 
CV Av-vQ=0, A>0, (16) 
的 两 个 线性 独立 解 。 方程 (8 的 任何 解 都 是 它们 的 线性 组 合 。 
证 由 定理 4.2 的 系 得 出 。 


$6. 最 小 解 
R.A}, 4, (A) eas se BS or RS 
bi; (Ay = fa Aa Ot iis, (1) 
Hiji (AJL, | (AYU, , Bij, 
pij E i $i (A) =p iP (2) 


BAIRE, ARE, il 
L$ W = bs Afi 
Stai CA) Dtr; ODS ty + hy: (A) Se CADE jee 


i>i 


(3) 


Cobi]; = D ibA) 


=w a ADU; D Oe CAD +H, OOD D IA 


(4) 

如 果 g=Ffh, pij 
POD = CAO Ie, (5) 
定理 1 
TEED. _ th) (6) 


what =. Hash) 
babi) t UCF, ÀA) 4,0, A) 


(Wer, A=, pA MAJAA) 
证 H (3) Æ C5,.4), 


a Do OCA) = CR) D Meiha 


tuu) Jaus) Dfe ut | 


FUE 


tgs) A (a) | 
=u A) [u uir, A) | 


uid | uilrs, Mui A) | 


= (ABT (A) sh) A) 
—t LADU, AD 
778 。 


+ Hh A), (7) 
WR BB EAH 


+ -l + _ 
Hie, A= air, hye Tae) 


1 
CP 154A)" 

(8) 
则 出 《5.147， 有 从 7) B (8). 

FALE (8) 第 一 式 ， 实 际 上 ， 当 六 流入 或 肖 然 时 ， 册 定理 5.9 
Cii), (iii), HaC}, A= co RiCrL,A)=0, BM (8) 第 一 式 显 然 
威 并 。 当 7; 正则 或 流出 时 ， 由 于 (5,14)， 具 和 需 证 明 

lim (At (A) = 0, (9) 
pots 


Mr, EM, PRIC, A)<co, Ui 4) =0, ER BRR 
3. A Fr iiih, Aa Ter... AD = O,FP AMA, ui) 
Bip, a 
Om, (AH, TCA) HGCA TH CA) — LCF AJl 
=mi D| ut Azaz) | 


~~ 47; (A) > et yA 2 54 — 23) 


ivi 
= HI (ADM (rs, A} ~ uai] 
-> — H] as RYCH, (Fas A) PLUT A}]=0, (2i—*r,), 


证 毕 。 
定理 2 设 f Em, ged, Wia Eem, ghAET, B 
ADODO- Oba = A>, (10) 

Agio -[g@A) 10 59, 4>0, (11) 


TE WRIA eA Care, Gh ER, 
由 于 5》 及 定理 4.2 系 ， 只 需 证 10) 即 可 。 实 际 上 ， 几 《3) 
得 
LAAS] suri a) Su, jh) fag tuti(a) Sas ity. 


jad fod 
(12) 


e 79 a 


D EDA] =D, a, tO) Sa, Fey + 
ti 


+ Duta) D u AM A 


+ Ee j Aua Aat Aa Oi 
= Aw (A) D maj AS ty + hh) De OF tty 
~— [TCAD ~ CART OA) I 
= MO) FI fi, 
Ss cm, ERA. W 


[PAF I(r) = hm LOCA FI, = 0, (13) 


i Araye Bira AJ<loo, A Hzr} 


Wi CA) ; >» 
aT, Ky ls WW, (AO, (bAa), (14) 


HURE, COCA) 10 =0。 由 此 得 (13). 

定理 4 tO DRED., CORES REAGE, 和 
r 沟 为 流入 或 自然 ， | 

证 $A) 宇 0 不 得 证 。 由 〈6) ARR eae. Mm A CH 
式 等 号 成 立 的 碗 要 条 但 是 r 和 ra 均 为 流入 或 目 然 由 (107、(11) 
WA, SOON A Bae AEROS AE RA. | 

wf em, &FOA)=dA)f, He B2W WPCA) - Pu) 
+ 一 FC) EE 是 方程 (5.1) 的 解 ， 因 此 是 za: CAD 
O MODARA, E 
F(A) — F (4) + A-R)G(A) Fu) =0,H, (A) tet (A), 

(ip) 


其 中 c1，c; 为 常数 . 
如 果 r; 正 则 或 流出 ， 由 引 理 3， 在 (15>) Pez 一 rz 得 


=EN, Crag) + emt A) EC aAa 
fac, = 0, 如 果 +s 流 入 或 自然 ， i Fu, (tro,h) = oo, Wi {res A) 
» $0 = 


<o, m 15) AAR, Albibae, =0, FRA uC, =0。 于 
# (15) 成 为 

P(A) FOR 十 《和 一 入) 而 (大 ?EC = 0, 
令 六 =6， 上 式 成 为 对 由 的 预 解 方程 。 

eR, OCA) BE a By Oe. EEDA 的 
最 小 性 ， 

He AOE, FOR, POA) RBA, Bik 4 1 国 
SW}, B04) 一 区 是 方程 5.0) HA Am 

H(A) 一 OCA) SOW (A) +e glk gi (A), (16) 
Hce, c ERIAREN. 

Mr, EMH, HIOA SRE, Eeh 令 ar, 
fie Ui(r,, AJ Cta lre, AO =C EC, ADO, fee, =O. oR 
rÉ RRRA W C16) FAR, Mu, a, Ao, (7s, AD 
=oo, He, =0. AEA, 0, AFER Ec 20, MA i y AD 
z=), HEE. 


$7. 若干 引 理 


HERITS IC 
x1 ay — PGD Kay = Bei 
> (A) uF, RY’ (A) itr, chy C1) 


fr, 
mi 一 -一 fy 成 :二 . 
Fo Fy Pe Ty 


er, TENET, XA) +O, “SrA RA Mit, X°0A) 0, 
如 果 Fi BF, re JU s 约定 X=, tn Fer, FOF re KF, ye 
于 1 =0 和 01。 类 似 可 对 发 ?进行 约定 ,区 "是 方程 (1。11、18) 的 解 。(6.6) 
成 为 


(23 


AG(A)L = 1—-X1(A) ~ X?* (A), (3) 
引 理 1 XA) EC. #701) (o=1, 2) EF, E 


APAK =X- XA), Gal, 2, (4) 
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证 X51(1) 朋 最。 由 (位 及 0( 和 A) 的 预 解 方程 如 XX 
。 sf 和 

是 列 协 调 族 ， 往 证 C4), 

ir; r HAAS, HRR, or 47 Sfr,(o# a) a, ot 
X= XA) =0，X"=1， 而 (3) 成 为 

A =I -A ), 

He ( 4) REE, > 

Wer... REE a =2 整 立 ，4 = 1 we Pik 明 。 
Ay 6.3) 

Desh) Oa = 25) = is (A) Ditag Os D (Zhe 24) 


=t hail 


Hita A) D A OAD D rg a) (6) 


jie a> f 


第 一 项 = wd E (Zapi Za) > Ma, Che, 
<a 1th 


+ > (244. 2a) Daw, Cn, | 


| =t Pale 


=O] Dre ~za) [wt — ut (rsh) | 


+ tag — 2 Lutilh) -u3 (rA) | 


hei 
=H ;{4) (4, ;(A) r A) SUT AG, ~ 23) 
~ 之 (ZEL1 一 wey (Py A) } 


WOT =H A) D Cr) DO Abu; 


i p a 
AoE royrak 


=H, {A} >> (2841™ 25) City, (A) — BTCA] 


hi 


=U ah) DS (ten dEl A) ~ uA] 


hai 
=H LANEN Or, A) — 6g (A) — UE AD O 一人] 
中 82 只 


=e CAML ~ CA) CRT CA Cr, — 2,34, 
RH ALA (6) 后 并 注意 《5.14) 得 


A DOs), —Z;)= {rs — 21) — H CAMS (Py A) 


— Hy CAC, =r U AD, (7) 
Ar ;有限 必 非 流入 ， 获 &, (ri，%) =0, BERG., ECR 
Ber, -了 ,得 (4) 对 a= 2 成立 ， 证 毕 ， 
引 理 2 Er MA. EMSA H. $ 
_ Hj 


Nig = hg ~ 25) bys Hi A= “ir, A) (8) 
Hm A) Erit A. mHE 
Aq, O04) S= L AA), (9) 
证 HEMS, 2A. 4, CEC i, RE EHEH 
wali, A) = —— (16) 


uii, Aot 
出 册 《7)， 注 意 《6.5) 而 得 (9) 


为 证 (10)， 由 (5.14)， 其 需 证 
lim [u (Aut CAED. aD 
Huti, A=, rad 
Ose, (AMT CA) =a Ae) -aeicr,, AT 


=W (A) > Abs (ADB; 


<M i (4) 2 Mu, OW) Bs 


=i (AD ay (A) ~ (ry, AD} 0, Ciri). 
此 其 (11)， 由 (9) 及 $(%) 的 预 解 方程 知 0,C%) 是 列 协调 族 ， wE, 
引 理 3 Per Evid. EHARA n Oo Ecrin 


要 条 性 是 97 以) 有 下 列 Riesz 表 现 ， 
n OD=p D Ch) + pK, (12) 
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其 中 常 烙 Pp, =0(a=1,2), “raft tH BE BARA B= 0, 而 
Ph) = { ®), 加 ?| 流入. (13) 
A (AJE, Wr EM. 


证 由 定理 5.10，? (和 2 有 形式 OA)acuw, Ow 
+C, (Ap, A n (Ok)EzE， 故 由 定理 5.9( 这 )， 当 户 为 流出 或 外 
PRAT, Cor =0。 因 此 1 (A) =, ,@, CA) +2, X* CA), Ar, 流出 或 
自然 时 ps = 0. A ENR, XCAR, HX CAUSE 
FEHB. ER nA) DOA), X A) ae BR, Be Por = Pa 
与 无 关 。 因 此 ?OA 有 表现 (12)》， 因 为 了 (3 由 定理 5.9 
(iii), pe0(e=1,2), RS, WODE 9 以 ) Et 并 日 是 
行 协 调 族 ， 证 毕 ， 

引 理 4 设 上 ，r; 正 则 或 流出 。 如 r, 正 风 ， 则 当 t co 时 
+20, Wo=a, 

1 ， Wb a €14) 


Ut =ACXO CA Yu, X] pus af 


证 象 (1.11.46) 一 样 可 得 
Ui UU? = VCR YM, Xio], (15) 


得 证 单调 性 。 其 次 ， 不 妨 设 Fr; 正 则 ,由 C4), (6.12), 
CAPAX Ij = Ant (A) Sug Ch) KI 


rea 


PAu OA Dou, CA) Xin, 


fit 


— { 一 1 j? - wt! + 
rr C CA] k- (16> 
dezir, 4 
U? =o X (rs, AD, (17> 


Bepxe G, A) = lim [XFA] AEC, RE 
rmn 
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Hm X?*(r,, 4) = +00, BEF 


A -+ 


limX: (r, WI=O0, (19) 
BAX tA), [K CAT ARAL BR, Be 
K Fa, A)— AFCA) 
i Fa ži 
由 于 (1.11.29) 有 XI 0A to, a=, 2), HERG 
1 lim 


< Dad E ae F 


<L tF, AD, 


Arzi >r, C13), K 


OE — lr,, AJE [XLA] 一 区 一 人 ie 


之 1] ey 
WBX O) ;0 而 得 (19)， 证 毕 。 
引 理 5 rR RIEU, XCM APR HEIR RX’, 


证 对 a= 2K, AXAN, RX CA RHR RX SK 
x*, Ai | 
入 二 (入 IX? = K*— XO, (20) 
ie RusX? ~ X8 FRAC 11.18 AR. C420 
而 (JU =H, (21) 


er 无穷。 Bir, — z Me Eu = Oy + Se FE ah eR, ti 
w= clr, ZY 0,2; =O yr, + (0, e)z 
Kaa FP. MEE C MWEC Ya, 
ALAJ = CiP AGA =c (1 XN) eK O), 


比较 (21) 得 cl = 1。 于 是 4 =0，X? = X}, 
Ber AGA. BPX, 下 :是 (1,11.18) 的 两 个 线性 独立 解 ， 融 
w=c,X+e,X*, HAKIDA 
WON) = ce Ath’ eX), 
$21), cX A) +e X (4) =0. HEr MBERE, We, 
cz =0， 因 而 t= 站， Ha WAR Ar Ay, ri 不 可 能 为 流入 ) 


* $J. 


Mc,=0, Higo<e,X}=wj<k?, 4 i+- coffe, =0, Mitiu= 
0, WB, 


§ 8， ,六 ,一 个 流入 或 自然 ， 男 一 个 流出 或 正则 


从 本 节 开 始 ， 我 们 将 着 手 构 复 一 切 @ 过 程 ， 由 定理 6,4， 当 i 
Ar FIA RAR RET, Seep ROCA) TE, ATOR ME. 
AW RA BE — Pa RA IER CARI. Bhi 界 点 
为 流入 或 自然 (例如 f1)、， 此 时 Wj(ri Apso, wary, A)<oo, 
因此 方程 (5.1) 具有 一 个 级 性 独立 的 非 零 非 负 有 界 解 X(X》 = 
KCK), BAe Tey eR mtl, 此 时 构造 问题 已 在 定理 2 ,2.1 中 解 
决 。 当 然 ， 在 现在 的 情形 下 ， 取 比较 特殊 的 形式 ， 


如 果 我 们 用 表示 定理 2.2,1 中 的 c- Le, Xl- 3, W 
e+[a, X —X(A)T+40 (A), X] 
=e+[a, X°+XK —X(A)I+AL nA), X° 4+ X] 
=e+La, 1-X(A)]+4LnCOAD, 11. (1) 
这 样 做 了 之 后 ， 再 将 c 记 为 c， 则 定理 2.2.1 现 在 取 下 面 的 形式 。 
定理 1 设 r; 流 入 或 自然 ,rs 流出 或 正则 ,3 和) 是 8 过 程 的 充 


RRR, 或 者 PAHOA), RAYA) WP eS: RRS 
esofieG ACE, Wee po 0(e=1, 2) Br RAAT, 


=O, $2(7.12)Ren(a), He 
TA) = (CK) + NN) TF (2) 

Rci 最 后 令 

Ds Ob, CA) + CK) 

i) = + XP OQ) 2 ue — —, 

c+ a, 1-X*CA)] + AL (A), 1] 

(3) 
过 程 # 太 不 中 断 的 充 要 条 性 c=0, ROE MRA 
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的 充 要 条 忻 是 a = 0. 


§9. 让， 正则 或 流出 ， 线 性 相关 的 情形 


本 节 设 1,、 RAEE. WREE AAO EAKINS 
LOREA. HIOA., WTP FAAA) 都 满足 了 
Seer, WAER Yu) dO, DHR, & 

Pir AD = OCA) + XECAPE CA} + AAF G), (1) 
Agi r FBP OO, 

我 们 将 确定 FrCh}Ca= 1,20 8D PRAO EO, ATC) 
HPO RE BAe PE CRRA Be eB ae EA E 

AF C7.3), HER Xr, A=1, Xr, AD=O(bea), BM, 
pA) 的 范 条 件 锋 价 于 

Fx) 20, ALFA), 11<1, ¢=1,2, (2) 

HOO RMR. BOL PRYOMRA RRA EG, 注 
意 癌 (Cs=IT，2) 是 列 协调 族 及 它们 的 线性 独立 性 ， 我 们 得 OCA) 
A THe Be SS ot 


f 2 
FAJA CA, v)=F(v)+ (0-4) SFA), Xv Fwy, 
ĝi -i 


a=]1,2,å, Y>0, (3) 
AE RPS, Fi, Fv ee, R 
Fayjy=m.4(v), 20, AVSD, g=1, 2, (4) 
H1.10.8), HACY, DARMA 


z2 
F'(A) = { wi, +(V—-A) DS CFA), KIV) Py } 
上 一 工 


EYA, À) 
从 而 EA, DAERA > oR, FRO Uv 0 
成 立 . 
由 于 (1,10.8)， 在 (2) 和 (C4) 之 下 ，(3) 等 价 于 
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F(A) = mt， 数量 my S0, FRENA)SO; (5) 
nA) A> 0) EF EAE (6) 


Mgl = Ma + (Y-A) > mL nN), KECY) IMa, 


a=1,23, (7) 

C7), WMA taRA> ow Mma =0, WA ma = 0 对 一 切 和 > 

nh Al Rem, ama = 0, BNA = PA, BRN) Om, 
+m,,>0, 出 (6) 太 引 理 7.3， | 

NCA) = abla) + DXA + py KA SD, (8) 

Hr gtn, MP. = 0, 行 矢量 a 二 0 使 a6(%) cE, Ek, 

由 (72 @miim,,=m,m,,, AFR HS 0, di +d, >04% 

: dim; =d, Mia (a 

Adds >, Hits, >0, 而 (7) 成 为 


doit, , =d Ms, tV Nm > dinta), Xv) TMar 


Ù = į. 
BE Lim, :az 得 
z 
dami? Sdm} + (vA) S dEn, a) (10) 


$4 
由 子 {1.11.46) 大 | 
(V—ADLACA), ARV] =vinvy, KH AEA), APT, 


cil) 
z 
国 此 damit- Sadana), X*]=¢ (HH). (12) 
bet 
FHC o> 得 
2 —1 
mas=ds {c+ DAAA), XJ) a=1,2, (13) 
k_l I 
将 (5) 代 入 (2) 并 注意 苹 ! + X*=1, FRA RY 
idi- d ACN), X*1<e, } (14) 
Cas E JACA, X iae, 


+ g * 


Se we AR Yd, =d, e=0. MORUT. A), 


2 . 
ALICA), X*]=ALed(a), K+ DS pALX’: OA wm, XJ 


be 9 
= Ta, Xe — XAY] +p, UI ++p UG”, 
APEXA) YA tR. LD, 
ACMA), X°]*W =le, X] +p, Uit pU, Af oo, 


(15) 
H(7.14), AtEW Ay MARY 
La, At] <I co, p,= 0, (16) 
并 且 此 时 春 
Wola, XJ] +E, (ba), (17) 
2 "4 
SRR, GO it TF 
c0, Mid, =d,, 
cz=(d,-d,)W,, fild,>d,, (18) 
ez==(d,~d,)W,, hid, <d., 


定理 1 Br, rot HBR EM, Mu Fea) (= 1，2) 对 某 个 
《从 而 一 苇 》 A> OF HEARSE. 

为 使 (1) 中 的 站 入 ) 是 Q@ 过 程 的 充 要 和 条件 是 ， 或 者 W(X) =O), 
或 者 #(X) 可 如 下 得 到 ， 取 常数 d, 之 0,，di +d, 之 0，P, 之 0 (r-i H 
mP,=0), fe Eel omedtAl CH, MACS) mar, Md 
(=a), PERG RA. MAH Bs) Haw 17)), 
最 后 令 
HCA) = GCA) + 
{di XIA +d KIA} Deedes (A) + pLXHC + pe XI Cp, | 


名 。 
e+ D dile, X*—-X AJ] +ALP X(A)E+ DX? AU, XPT} 
b-1 


(19) 
SERVO AR I ERLE ed = di c= 0, RMA 
Hy FAL EB Hh Se = 0. 


+ fo a 


$10. x 、 四 :正则 或 流出 ， 线 性 独立 的 情形 


BPA) (a= 1,2) 线 性 相关 。 本 节 假 定 PrCh)(a= 1,2) 
线性 独立 。 
采用 矩阵 符 导 是 方便 的 。 记 


1 
[y] = (zs yd? 一 Cyl, y’). 


Erhy', y ERER., Mme, ete 1, DEZH, WY, 
o BCS, WATR pry. BEROA. 
IXFE, (9.1), (9.2), (9.3) RA 


YA) = PA) AIXI LFO] (1D 
[FQ (07, {ALFO), XI}[1]<C1], (2) 
[FCAJACA, V7 

=lF(v)]+(v-A){LFO), Fv T}EFO I. (3) 


Hi EVAO, WA). WERK Be’ eas 
1, 24a ACE, FEDME, = iD SO, Aa = (M59) 
0 (rH LT, M} = Mie = 0) 合 | 

CFA) ] = Bap + mL XCA) HI, C4) 

证 RAYA AOME, #(2)(3) ee. 

HD., (3) BEL. SEERA, voo, CRA AA,YW)IS(0], 
SAEIA, nv HF AAG, v), nv Aw A 
族 ， 因 而 依 引 理 1.11.3 及 引 理 ?7.3。 丰 在 与 ?无 美 (但 与 4 及 %\ 有 关 ) 
HRES SO BIOCAY CH, HA 


VFUNIACL, VSEGA, VIO = Bi, (5) 
PuURACA, v= BAOD + MINK! oet MiX AR, 
(6) 


HP .= (MIDS avak AIG, Mit=Mit=0, 和 性别 
HL, MV AA 
AF) — Fah yO = Bi, (7) 


+ Of >» 


CECAIS LEICA] + Mil XAT, (8) 
Fe, SURBEEHA, FATE SAT APT RECS a=, 2), 使 

Bli=riieaiarite, (9) 
其 中 i= rien., MECHA GEI), HH BIG CF 
BFE BOA) E ECM Ror Herp =0, My ee = om 
有 i 的 值 )， 引 理 便 证 上 明了， 

HFS). (7), HOI- DAR DAU 

LJ=S= CARTACEA MTEGA), XEON JCA], C10) 
Fea Bi AT), FPA MAR A> OR eA Bi =0, Wi xtv> 
AS 6} = 6? =60, AMAA, Bi =B. KN CAF ALR, 
只 需 取 w =4 =0,8%1,= 080), RIERA > OA Bis OCa=1,2). 
设 

FJ 4 SI+(V-ADMLF(A), XW) I}, 
ETERA, MOTHE A 


Bi 一 站 有 十 a=1,2, (11) 
FFE Vo ABT 
Otis Bex Bi, o,6=1,2, (12) 
售 若 对 任意 % 沁 0， 当 Y=>co 时 ， | 
ti 3p!-+g, ag=1, 2, . (13) 
MHC), SEE BAD O, Hvort 
ti B — Bi, o=1,2, (14) 


IERARH >0, $ espi, WAD, 
Bi = tite! EERE, 
ERAA SVEX, AAMA 13) 4 vcw Heo, 由 于 
(14), AA BBs Te aT Ce SE eri *, 从 而 取 极 限时 
我 们 得 
Bi arite, 
JH nh 4 SAAT RGD), 
倘若 (人 13) 不 成 立 ， 网 存 企 k: >>0， 某 af 不 失 一 般 性 不 妨 说 a; 


+. OF # 


= 1) 及 于 列 v 一 cc 使 
站， O<e'< At, (15) 
MRT ERAS 0, Hvr, cont Ay 
tit, Bi, 70, ¢=1, 2, 
则 象 上 上 一段 证 明 一 样 ， 闻 样 地 可 以 证 明 
By=rita', ocea'-+0, 
AmA RIRO). AW, FEA, > OR Me, ( FR-MERG, = 2) 
BVH FPL) oo fk 
bik, oPh cay 0 (16) 


REIER, (11) 可 以 写 为 
ii tii 24 2i zti 282 一 


RIEN LY CORTAN, (oo FIT AEBEA TEA FD), 使 当 
v= D> atthe aR a ri’. rit. PM 
(15)(16), EAP Svs v,(2)-> oly 

Bi =rilel +rj*a*, 
由 pel, et Ah, AR = C DRS., IRAE RO), 证 毕 。 
HF SHEL, BS RAR SBI an 01). C4) BORE PA) 
Ap Hy 


引进 记号 ， 
hiP=ALorB AD, Ke]= Ca, K? XA), 
+ he= Ea, X91, At co. (17) 
A, = hI) = h, Nf oO, | (18) 
EPS RISE XA) 0A t oO) R764), HF C1.11.40), 
(v= Labia), Xv shi’ ehit, (19 
先 考虑 一 特殊 情形 ，.4 :=0， 瑚 一 co。 
BP CFA] = #, Lee), (20) 
re, 1], @=1,2, (21) 


定理 2 HPPA), F'O) 线性 独立 ， 并 有 旦 具有 形状 (20)， 
(21)。 则 由 (1) 懈 定 的 (入 ) 是 9 过 程 的 充 要 条 件 是 它 可 如 下 得 到 ， 
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MAR MTA He’, a” 线性 独立 且 满 足 
Cæ, Wisi, @=1,2, | (239) 
然后 令 
pla) = OCA) + [XA EH Fa Eet], (23) 
Srp. ={Le, KA] 
过 程 #X) 不 满足 向 前 方程 组 。 撩 量 c: 和 ez (它们 满足 (22)) 
计 过 程 唯一 识 定 。 过 程 %tx) 不 中 断 的 充 要 条 件 基 


fe", 1]=1, ¢=1,2, (24) 
证 (—) HOREA PROOI. KORAD 得 
FLISE 。 (25) 


LEGO RAG, ÆC. 10.9 及 (19) 得 
F alapi] R Eep] + RE REO RRV e 

| (26) 

将 (vI- 0) 4738 ER 
. 需 1[ = Fe] + Bi #,— RaR Le], 

BERRF°CA) (a= 1,2) PEMA, C20), @ Ale? 也 线性 独立 , 故 由 
ERI | | 
CPER ER AE FET ANE (27) 


Jie BR T yj > 00 ft 
R i> BE, | (28) 
由 (25)(C27) 和 (22) 得 | 
#&#UI<SC1, (29) 
RU-RU- 天) 下， (30) 
& [a]= glen], W., GORA 
(e*, 1]&1, ¢=1,2, (31) 
=d- FE, a= {a XOA (32) 


{Apy(31), Cet, XA) 4X2) 1<1i(e=1,2), MENER (一 
7o PREHEN. 由 《$2) 得 
U- FO’ F. 


s 9f * 


LA (20348 
LFA) |= Fatol, Rid- Fat, (33) 


剩 下 需 证 ec: fle’ Ry, KM EL, Ab ee? file? 
PEPER, WFC), FCA) AR PERE, 
O (ZI) Hal, cb ih, REM 22), w) 中 已 证 
WH, wie gy, = d- FO REHE t. 
由 FFGA)T- (一 .1)-!:[a$(%)j 定 义 的 FrA%)Ca=1,2) 线 注 独 
ME, XEBE, 8 
O= Le] LFA] Ee] Ad ) Eep), 
UAR- Q) j | 
e O=Le]’U-.7,)7'Lel, 
haca =i D AA tE, Led- ga) = Lol’, Ceco, 
H22), #(011<011, PEO- anl AA- Cl] 
= 4,01], ERI- o ER, WEH- 7a ra 
AEDE, AED R., 直接 验证 便 知 (27) 满 足 ， 因 此 (26) 
成 立 ， 从 而 (3) 成 立 ， 
(=) Wve’ a7 tk Mayr, Mey AEA ECA) +X OOF OA) 
满足 
(Au — WO}; = CRA] La ie D, 
Oct FPA) ANTE BU AR 
为 使 (2) 即 (25) 成 立 等 式 ， 充 要 条 件 是 I - a) aw 11 = 
(11, Bp 
(#- F 1t= #iL1J=U-7 1), 
BB°L1J=Cil, C24), 


Bak a= 1,2)3478 (22), AAAA, BY 


(Fob) = (= F457 [ae (4), 
Hæ- ORG 


Ad- Fay a= Hd- ay Le, 


e O4 © 


由 于 Xe LOCA 4 co) FR (22), FELASA t ee 时 得 [ec]= [2x]， 
证 半 ， 

现在 考虑 一 般 情 形 。 

定理 3 设 Fh)(a=1,2) 线性 独立 。 为 使 形 如 (1) 和 (4) 的 
%(X) 是 如 过 程 的 充 要 条 性 是 它 可 以 如 下 得 到 ， 取 非 负 行 矢 量 o 《a 


= 1,2) 68 af6(h) EE, Hic SAE = (D, h (M 


as ) 具 有 下 列 性 质 ， 
(i) Ari, MM = 05 
(ii) 或 者 Mom>> 0(a=1，32) BE RM™=0, Mh >o( bea), 
0; WEM =0(@=1, 2), at, oe Bete Mor. 
(iii) Ae <oo(asb), 
(iv) sitea], s?!<1, 


gab o> yb 十 


= , (a%6), 


Fs 1 


Rra I~ GF +H y+ Ui, } (33) 
= K+ Bit esi mM, 
Sich a, t CRA co) 对 Woo=1，2) 接 (17)、(18) RE, Te 由 
(7.14) : 

十 co | 

a= Fi 

rium te= | 1 Jaton 

Fo Fy 


(34) 


MCAPECL), COGI, 
ERVOOR HE (hy BEER PS tostt 1。 过 程 满足 向 前 
方程 的 充 要 条 件 是 [e] = 07 过 各 WX) 具有 形状 (1)、 (20) ,C21) 
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FEB EM! = M2220, ft*<co(a31,2). 
证 分 几 步 证 朋 ， 
(=) ROMRYA)BM1). (4), WAMPCi(a=1,2) & 
性 独立 。 @ 
特 (4) 代 入 (2) 得 
F CISL, FERRA. (35) 
CARA G), WT 1.10.9), X*CA PAPUA HE 07.15) 
AIC 19), 
# Lad(v)) + ROH = F Lad(v) + .LXV 
+O FB AAY ~ FOF adv) ] 
+AA LX], (36) 
Hol- DRR + I , 
R Cel = RUJ 二 URR, + Mit, - FRL, 


CHCEL ERTER AN AEE EAE AEAN (37) 
AR AC 36) <4 
MIA P+ Bt MUM (38) 


令 Si=1-si%, W A>. Reb, C35), si So. 倘若 


a . 
Of =O, Msit=1. p35), sit= S rihit+ Miu) = 0 (ox 


lui 


Gi riw =M =0 (t=1]，2)。 从 而 


z 
s= DPR + Miu =o, FA., 


+ 1 


在 (35)，{37)、(38) 中 除 第 a 行 以 0 得 


_ Wiz i 
FEJE, z= À si ). (39) 
si? 0 
A lajad- Pit Rat WL], (40) 
Mi =~ Fit Bi, + AYOM (41) 
其 中 =0 @=1,2), (42) 


= 94 + 


f 1 IT-1 
rea Mi= T (44) 
RR FFA 00 fi 
Pie Bi, AiO, (45) 
WF = (9%), Fere, #=(M*) aR, AGD id), 
s*=( (@=1,2), Si?<i, s*t<i, (46) 
i Fi 
st D rihta S Mal, (ab), (47) 
imj t—1 
RJE- FRR, + AYORE. (48) 
A = K+ RH + MUM 1 (49) 
(约定 0+o00 = 9) | 
由 C47) 得 l 
Mi2?— M:!=0, (50) 
mht = co, Mir’ =0 (a6), (51) 


由 引 理 1， 本 定理 的 (i) 成 立 。 今 令 [ e ] = Flel, MW oto 
县)EFG=1,2)。(50)C46)(47) 成 为 (ivY)。 从 而 有 (ii)., 


(48) (49) EH 
La]=(l-¥+#,4+ #yv,) Ble], (52) 
A= (+ B+ UM, (53) 
往 证 @° 450, WEM” = 0, (54) 


HARRE, PRM! =0, @?=0, MHG, (53) 得 
riig!l +rlig? = si2(riio! 4pizy2y ， 
M= si1*Mi’(a=1,2), 

于 是 FP: (A) = 3:2F2(A)。 这 与 FI(k) ,Fa 人) 线性 独立 矛盾 。 

FE a PE 

Sole Ft Rt we Yo (5 

HAREM. Mi (52)(53),#@ le] = ZILE, = 25! 

a oF o» 


NES 


因而 
(FM) ZT BEG NI] + FTL XK, 
CFA) |= ZI ab (A) 14+ SrtA LX), (56) 
Eyk), (4), (3) AE. 
Fa Civ) (54), (34348 
[> st (ht Mele sy) ce seh (he Meut, Ca 
Xb), BEI- F+ F, + NY, 具有 形状 
1+1} 一 在 下 十 四 
(ia ene), T+i°* ot, 0, 
MHA RA>O, HPA a iy 
+t? 12! 
AC yi: 了 十 了 1 )=0 
(D FEUEF*(A) (a = 1, DRE Fe AEE Gi), 
显然 Be(X)(a= 1,2) 线 性 独立 等 价 于 [ aha) + AXA) HI 


线性 独立 。 如 果 

Cel (Ch ed) + MEX) ED =O, (57) 
HEROL- 8) 后 得 | 

[ey’lel=0, [e] # =o’. (58) 


反之 ,(58} 成 立 , (57) 当 然 成 立 。 为 了 由 (58) 推 出 [ec] = [0]， 必 须 
fo FA ie (11) ee. 

(=) Bial, F, MHRA. 

Ala (ii) G), WECO Ey NEEG) 存在 且 非 
fo ATAR) CBs po RRR o, 2=1,2.)(33) HRY). 
往 证 (2). (3 成立 ， 即 (35y(36) 中 将 [e] 换 成 [四 r 后 成 立 。 因 为 

(8H i+ WI = i 1+ #71) 
= gi -AYE r d- 01), 
由 于 (iv) 及 230， 故 将 [ 4] 代 痊 Ce] 后 的 (35) 式 成 立 ， 
其 次 J- BiH + yh: +B. H+ MY, 
= 2705, - Fo HULA Æ+ MY) 
= yl K+ H+ MUI = LE (59) 


a O39 + 


Bik, let, ZRBC, PREGGY, MBL &] 代 
4 Lei AY (36) Re aE, 
《四 ) 往 证 (56) 具有 形状 (20), (21) 的 党 要 条 性 是 
Mt! = M2?=0, h<co(a=1,2). 
证 5563 具 有 形状 (20) (21)。 由 定理 2， 即 
TPN] + HEX ERD) | 


= (F-.F,)7 Tepo]. (60) 
AiR ~O 得 j 
ZE e= deya) e], (61) 


WZ =O, #=0, AWM! = M22=0, BODL a] = 2, 
a(i- 7a) Ea]. Pale, 1<1, wR< (G=1T, 2), 反之， 如 果 
M!!= Mt? =0Ẹ he<oo(a=1,2), M56)H HCO T4 RAWE 
ROCO Gi). | 

(五 ) 关于 过 程 不 中 断 或 满足 向 前 方程 组 的 充 要 条 性 明显 ,证 
FEY 


§11. 关于 ob CA) cr 的 条 件 


ke0, PAF 7.3), boc Fett FT 
mall — XP) -X (A) ]<oo, A>O,. (1) 


A ae i EE RE OF Beda) EE 的 充 要 条 人 忻 。 显 然 ,只 需 对 《1) 

1 Dk DART, RANA DME Dee aw M 

的 ， | : 
引 理 1 对 定理 5.9 中 的 ea (A) Fle, CA), 有 


23,,-2; 
+l i (3) 


Wi (A) = Hi) Ait A 


证 。 设 (2) 右 方 确定 的 量 为 Yi(*)， AIEO EAEG.. 
的 下 降解 ， 且 对 用 YO} 代 炮 wj CAD RBCS. 14) Bee, 


» OO >» 


由 于 xs (A) Ales (A) 


— ”., 


Nery CA) = a (Ad 之 五 ESTATES 
1 1 1 
=t O 一 | 一 一 一 -一 一 一 
uzi ) 之 HICA) EmO ST 


<Ha -1 .. 
iA) =I i ley CK) Mee 41 CA) | 


He fA) 1 _ 
WPCA) L Weith) ty (re) 


— 
rr 


1 
E — 一 
wih) Soo. (3) 


LEELA 其 次 ， 


+ (NY =u, A ZirT) 1 
Vi , H3 ( ) 之 tin CA He 41.04) Win CA) i 
(3) TTi, 


PEC 


fai 


1 __i 
Uith) lei (A) 


因而 vG FRR, h, ORAVA Re, CAD C514) 成 立 ， 
由 (4) 得 


DvO) = Duta o Ei TF 
VEO) = Diu; ( ) 之 TEST 


=ü, 


= Mei 人 之 TO rh) 


= Av CA), 
即 v (和 ) 是 方程 (5.1) 的 正 的 严格 下 降解 。 
当 rs 非 正 帧 时 ， 依 定理 5.7， 满 足 (5.14)? 前 方程 45.1) 的 下 距 
fu, AME, BVA) =u, (A), 
当 rs 正 出 时 ， 依 定理 5,.7， 
VICA) = Kv; 一 st]， KA is Bt 


(2). O=VEFL A) = KL VG) ~ Bsr dT, e= 20) = 9, 于 是 


StF, y 
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VA) = Ku, (A), MATIVA = Kuit, 由 (4) 及 (6,8) 第 一 式 得 


I BVT, A= Kur(r, kh) 二 一 


H, (ro A) 
mx = 1, 具 而 YNY = a, (A), HE 5c. 
S22 Br EWE, D 
lim Bin) 1 


到 -一 


iE. H2), 
H(A) 


Hy, CA <r aR D Gj - 25) 
jun 


EIES ]* 
iant) 


HinlA) > Tact, 之 (2417 2,) 


z- sth) {rs -= Zad 
Lu.tr,,4)]* ° 


O Ba Hin (AD 
fu,(r,,4) ]* rom 2, 


Ro 


由 此 得 (5)， 证 些 ， 
定理 3 wr 正则 ， pif 


LI — X4(A) ~X7(A)] <eo 


ina 


BR 
Sailr, 20) 00, 


或 等 价 地 
io， 


tego 


其 中 


= ky Fa 一 ie Haira, A) ° 


Wr, ,AY * 


(5) 


(7) 


(3) 


(9) 


(10) 


i f 
N; = > (2341-23) > = (Sus Kraz) 
t-a 上 一 从 


i*i 


F > ‘rs 一 Ža) Ha, 


k>i+ti 


(11) 


+ 了 人 了 * 


证 K 
L—X1(4) XFO) =A A) Du, A) By 
pad 


tAn WV) > by OB; (12) 
mr 正则 时 $ eco, CS), Mt + oo fy, 
. -Fo 


A 
oe HAA Su, Oj< MOLAO ) 2al T 


razi Sr r,— ži 
=0. 
FAL i 
lim Lo XM) KIA) A Tm MiG Sa, (AD By 
i++ Fo Zi iste Ta i SH 
=ADX* (Ayn 14, 


Mr JEWS. ALX Gje, 1 <<co。 由 此 便 知 (8) 与 (9) 等 价 。 
Hee, Gdo BAHE. A AD 


Ni<< (re 一 人 之 出 ， 
Ber. TE Was) GAG do, WEB. 


定理 4 设 r: 流 出 ， 则 〈8) 与 (10) Sf, 并 且 推 出 (9) 成 立 ， 
证 Fy (6), (7911), 4ieizok 


ES iS < (13) 
WN) > Oe -z;) 
tye Sza)» (14) 
HA aN S ue ON 

(15) 


1 
< Mag Chie ” 
$1022 


E TF 


Ris ony, 


i 
Hai CR) Dots ghd py 


-0 


入 . 
g” iO Sy) =a, C16) 


Pom zi 
Hii (A) Doe QM, 


~ — i be ofA) aan ef Su, ORED . (17) 


e= 21 -0 


衬 是 由 (127 (15},(16),(13), 
1- XA) XA) 和 Somes) my 


= 


N; ty pA) 


fo. 


{ S Ore — 24) 
jo 


FA) . 


Py ži ON, 
(A) (Fa m 23H; 
+ bait 2 z a s( By 
Ni 之 CA) LO 2 ° ms 
pp HLADA) og Ui) 
Fo 一 全 ji He o (A) i 
由 (5)， 
lim KX eo A KESTY 
im WN he CA Yee 2l ks 
HCF, AJ _ 
十 入 十 太一 2 (18) 
We y{h) ~ 


PAE HE, pa (12)017)(14), 
Huh) 


-XIA XI 
1 Saw 


+A Had > Wa CAH; 


Ri { F u T a4 J 
aaao , Ae 


F= i N; 


«703° 


4 haath) Wil À) 


一 一 一 E P — 2;) 。 
N, 全 


Hy Mere - ži} 
9 


A CAM, ofA) è ( 


{u.(r,,4) |? N; 
之 (Fs 一 之 有 
Alb CA Jib, g CRD a if — 2 2 
Laa Era A] N; TRAP ORG), 
lim LOA XIA) Rh) 0, (199 


i = + w N; 


由 (18)(19) 便 得 证 定理 ， 证 些 ， 
ems 设 r; 流 入 或 自然 ， 刚 (8) 成 立 当 且 上 内 当 
Sado, (20) 


Fad 


E 充分 狂 是 明显 的 。 必 要 性 从 
lm (1 ~ XH%)) = 1- (rN)>0 


得 出 。 


TD 用 二 


第 五 章 ” 生 灭 过 程 


1. 引 # 


设 E= {(0,1,2,3,--}, ORABR 
~ (a, +’) 已， 0 
2 = 0 G; -(a,+5,) 6, | D 
Hifta,20,6,>0,4>0,5:>00>0). 我 们 称 形 如 (1》 的 @ 过 程 
为 生 灭 过 程 。 本 章 中 @ 恒 有 形状 (1)，@ 过 程 便 指 生 灭 过 程 
Reh, SDPO, HAW 


a= >a; (2) 


fat 

4a, = 0 时 满足 ， 4a, ORT, EAX = 0748 BE. Bila, = 0 时 ， Q 
保守 ， 当 ao>>0 了 时，& 单 非 保守 。 当 a, 尖 0 时 ， 解 空间 .4， 的 维 数 
m'al., AEH a = 0K Ra,>0, m* =0 时 ， 生 灭 过 程 的 构造 已 
在 定理 2.2.1 和 定理 2.3.3 中 解决 ， 当 ao>0，P+ = 时 情况 稍 复 
杂 ， 因 为 此 时 可 能 存在 浦 是 向 后 或 往 前 方程 组 移 Q 过 程 ， 也 可 能 
存在 既 不 满足 癌 前 也 不 满足 向 后 方程 组 的 过 程 ，。 

RFellerL5] 中 视 生 屎 过 程 为 扩散 ， SEs, > OnE FT 
同时 满足 向 后 和 和 疝 前 方程 组 的 全 部 生 灭 过 程 。 作 者 [2] 中 构造 了 
全 部 生 灭 过 程 ， l | 

ARIE A RI i’. SE- ERUERA 8 
ae eat, A Re RITA B BRA RE 
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$2. 边界 点 的 分 类 和 二 阶 差 分 算 子 


对 于 (1.1? 的 2， 称 
(2 =! » Way > 0; zc = 0， 如 果 ao = 0。 


| (1) 


pn 
La 
为 自然 尺度 ， 称 | 
z= limz, (2) 
AA Rs 称 
65,8, 
Ho=1, ye a (n=), (3) 


为 标准 测度 ， 
通过 自然 尺度 和 标准 测度 可 以 将 边界 点 2 分 类 。 说 边界 点 = 为 
EM “如果 z<oo, Duco, 


流出 ”如 果 z REM, De-a), 
HA MEEN, D zi <co, 


”自然 其 他 情形 
”还 引进 下 列 特 征 数 ; 
my= p= (e172 Meos } 
my = > b; a TTR l 
= (Zip ~21) x Ti, i 0, 


E=0 


© 106° 


1 Sb jbj, eb : SG | 
e= -+ S aH t (23-23. 1) Stayt 0. 
k-i 


ds A Uidir pt Oi, ire 1 
(5) 
Ni= ym; = (z-z) Sut 5 (S22), (8) 
j-i i 一 二 
R= > m= >, (2-283, 
D _ (7) 
S= >De, 一 之 3 和 


定理 1 边界 点 > 为 

正则 SAR Row, S<oo, 
MH 4’AMY4 Rc ,S=co, 
流入 HRH R=co,S<oo; 
自然 当 且 仅 当 Raw, Sam, 
证” 司 定理 4,3.1 | 
可 以 按 (4.4.1) 引 进 二 阶 差分 算 子 ， 但 在 1= 0 上 要 作 适 当 修 

H. 
BuyE LAA, Eu TF: 


wpa Mier TE Cig) (3) 
Hin. fi 
为 了 方便 ， 以 后 约定 
ur, =a, ,#_,=0, C9) 
设 # 为 {一 1} UE 上 的 列 矢 量 ， 定 义 D,w 如 下 ， 
D nr ed Ciz0) (10) 
Hi 
定 埋 2 没 4 为 E 上 的 列 秋 量 ， 出 
Ou= Dut (11> 
BA ami. Cat biu t buna =D, uy, dO, (12) 


e407 * 


证 ” 同 定 型 4.4.1， 但 需 注 意 约 定 (9)， 

定理 3 ”定理 4.4.2 及 其 系 ， 引 理 4,4,3 仍 然 正确 ,只 朗 将 E 理 
解 为 非 负 整 数 集 ， 马 为 (1.1)? 的 上 矩阵， 其 至 连 记 号 都 不 用 改 蛮 ， 

引 理 4 方程 


— (ao +h, Ue, + bu 一 = fas 


dilja Cait biu; + DH 1 = -0<i<n, (13) 
un = 了。 
的 解 是 
= oy Hj; Eo (2; -Fa 3+1 
“is Gg(Z_,-Zy)} +1 ot G,02,—- 24 SEEL 
i—i 
了 三， 一 三 
ae TI A T ~zo) + 1M yt, 
一 十 
z, SAE Ten =z; ilj. (14) 
证 pt4.4.12), 
ap ee aptrian _ 
Wiz Tn? Sits Z =z, 一 了 $2 Sey, Za hon, 
Zi a _ 
zoz. Se, —2,)f tj, 0<i<n, (15) 
l 2r 1 ži 0 
REH GORTE 25a m 
Z,-2 
+e, ze. ~2,)f ts. (16) 
但 由 (13) 
ba 
Mo Ga, tb, ar “Tb, 
O)(2;~2,)+1 Ga(2,—Z,) +1" 
ME) “17) 解 出 
Ha = oq Ea 1 — f, 
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ay(Z,—-£,)+1 


ot GZ- Za) +1 


1 = 
+ Uz B ed D Bn 25) Fits 


代入 15) 中 得 (14)， 证 毕 。 


引 理 $ ”方程 组 
Dut =f, 
ll 一 《Gu +b, tt, +b 9%, =F), | } 
aH T (a; + BOW + Opti, 1 = f; >00). 
的 解 是 
『 一 工 
w=[a, {2i~ Za) 十 工 .十 S (4-25) F lta, 
:=0 
证 (19) 即 


ui wt = fay, i>, 


rca tj =u utt E n} H; 1) = ay pfa Df 


1=1 fal 
=G,W,r > fils, 
i- 
id j-i 
U= t © (jp up) =U + Doe Ay 24) 
d =f r= 


it i 
=H + > (ast + > fatty (2341-21) 
i-o K- 


i—i 


= lbg + agli Za yg + Seez) E fn 


7-4 Kad 
=[@,(2;- 2,)+1]#, + > Cai— Z Siha 
-0 
k 方程 


Qu=0 
BY AR 


(20) 


C21) 


(22) 


» {09 . 


t; = [a(z z) + i]t, i= 0, (23) 
$3. 方程 Au- Diu" =0 的 解 


定理 1 对 每 个 * 汪 0， 方 程 | 
Au- D,u*t=0, u,=1 <1) 
RECA FEET BME, AAP STEM 
Ci) 到 (和 8 人) 均 严 格 增 加 ， 
(ii) u(z, 2) = limu,(s)<0o BARS 2 为 流出 或 正则 ; 


(iii) w(A) BE ERlu*(z, A) = limu (A) < co HA 当 z 为 正 
刚 或 流入 ， 
证 由 (2,20)，wit%) 必 定 满足 下 式 
“WA. = 1 +a — 2) + 5 (i ZH CA. C3) 


由 此 可 确定 & CA), 4. 0A), , CATER ME, H 可 
Ee) 严格 增 加。 
Fixe, utd) =a,+ SY wp adn, 


FIET ub), (3) 
了 一 由 
fete (严格 增加 ， 


Gi), Cib 的 证 盟 同 引 理 4.5.5， 证 毕 ， 
定理 2” 设 #() 为 (1) 的 解 ， 令 


x 
WM) =t; Oo) Dar ty (4) 
mivo PERS P BE, v OPER Lt, E 
QO, iio, (5 
AWAD -D vi (A) = 5) 
Vit } Vi { } p , Mi=0. 


了 TD 。 


u AV (A) = VIC WG) =1, 120, (6) 


+ : 1 
= 十 一 一 mn- 
vita, A) amv (A) ucz, A)" (7) 


(uZ, k) = cht, EFHO). 
WE RBI. 11.1 RE, 类似 (4.11.3) 可 得 (4) 中 级 数 的 收 
Ore, EKA.. 06 


A + jel 74 1. 

VIG) =u, mt uth)" (8) 
+ 1 
VEAST 57 TEES) =, (9) 


放 Y(%) 严 格 下 降 。 和 由 (3) 得 (6)。 再 由 (8)， 


YT) Euo Žin Fi 


TH; T“ (ABs. (A) uC) 
1 1 1 
-Sipoh a (A) 
z2 €l 
ulz, Ae l ‘ (10) 
由 由 得 (7?)。 从 人 (8) 及 (2.10) 得 ， 当 i>0 时 ， 
+ 一 at co i 
D yty =D, Od PP R SOIS 一 和信 大 
得 证 (5) 第 一 行 。 为 证 第 二 行 ， 注 意 接 VX) 的 定义 (4)， 
v Od) =v, (he, Oh) YN (A) bat, 
jth) 
(11) 


H Puc AECL) ARE. A 
bu, (A) = Ata, +5) Cs) =A+ a, + 8g, (12) 


RACER, wee, 


§4. 最 小 解 的 构造 


XI (3.1) AYRE OO) BRS. DORER), & 
= TilT" 


paya) = [BOOMs it, 
Wh Bist, 
J (4.6.1) —-( 4.5.5) 
iO, 0A) = HO (A), 
EJIRE, JARE, M 


TOAST = D bF 


=V Sujal utes D vf 
Foo 


j-i+l1 


[ght 1;= >) gpu 


= V CA; > gM; (A) +4, (A) BH; > gitA). 


1-0 fw ib 
如 时 9 = ju, M 
gia) = pe, 
定理 1 - 
aD usl ov) SE 


(约定 二 = 0)。 
证 由 (3)， 回 忆 约 定 (2.9)， 


hhh) = Vth) S (ety) HFa A) 


1- @ 
w(K) > FA vii) 
joists 
=Vi(h)Ut(A) ~— 4 CAV; (A) — Vi) 
tuAo, À), 
由 于 (3.6) 及 (3.7)， 上 式 即 (6)。 


(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


定理 2 fem, ger, MtO Em, gD EEF, H 


* 712° 


APODI- OLGA =f, ADO, (7) 
ACIONI- Egba) =g, A>0, (8) 
证 只 证 (7)。 对 i>0， 证 明 同 定理 4.6.2， 但 对 i=0 则 需 要 

人 小心。 由 3) 得 


CODIE Ss yt Dh 


i-a@ 


+u) D, usa sry (9) 
forth 
[HOYT TE =vich fo ted) Svat sy (10) 


fel 
回忆 约定 (2.9)， 
Loca) dry = a, Léch df, 


= uove CAF + Op, lA) D> Viti pity 


i-2 
= Vi ho tut Ca) Svat jus, (11) 
fol 
由 (10)、(11) 及 (3.5)， 
DIE =D ve fo + Duta) S vss a, 


j-i 
= (Av, CA) 一 Df, + Ald, (A) > vy (hE ity | 
i=] 
=[hA FI, fa. 
引 理 3 设 1 ER，z 为 正则 或 流出 。 则 
EPONJ] Cz) = lim CA) 1, =0, (12) 
证 ”因为 2 正则 或 流出 时 ，2 达 co，H(t2， Acco, WHY) 
的 定义 (3.4) limy (A) = ¥(2,4) = 0. 由 (6) 得 
[ATIF = 0, AER). 
定理 4 ORE QHR., 6D RPM EEE E a, =0 


a 


HEJ MARHA. 
MzB Rist, pO EME y E a Ay BS Oct 程 。 
Hz ART, GO) Ei a eae One. 
hz ot, OCA) EEH TE) BO PR OT 
证 OO TES A EIB. CODA BRP Re 
HB. WHOA WHR, Sfem, FA)=GA)F, W 
F(A) - Fiv) + (A-vW dQ) Fv) € mB BHO. DAR, HK 
F(A) Fiv) + (A- Vv) OCA FCV) = ce A), (13) 
其 中 ce 为 常数 ， 如果 z 为 正则 或 流出 ， 由 引 理 3， 在 上 式 中 令 i-xco 
fgeu(z, A)=0, c=0，。 如 果 z 为 流入 或 自然 , 则 由 于 (13) 左 方 有 
Ki, wR. te=0. Bea Ac=0. Wiis dEi OO) 的 
HEDE. EH. $C) 2 LEU AL A Ba ORR, 
KYO WEBOHEH, WHAFMAARGA (1.8.10 Mew 
1.7.3, HJE ER, u: =p; A) ~ 6,0) WE 
Au; Do intl = [Oe sit = oif, 
K 0 836, i>r, 
Mu- ev GoT 3.1) BAR. AT t- eceivi hetl), 
Bp 


(14) 


Pgh) = Piah) HCNA HCNA (15) 
H pe, Cs 为 与 1 无 关 的 常数 ， Cipa 

WEER E M, HUES RAR RM AMYCe, Ao, 
fe GD Heije utz, A>, we, = 0, MAR G R 
由 于 5) ZAR, HIPER, be, =0. KEEA 
CD， Bvt S ba), FiO A WBA, . 

AACA =1, HERI BM Ae, =0 且 z 流 入 或 自然 ， 
| ARVO RIAA, Wile, =p -ou CG) 是 方程 
(3,.1) 的 解 ， 故 | 

Pil Ay =O ,CA) + CUCA Y, (16) 
epee 0-5. mE AN E AR RREO R EDE E, 
Wike=0, EEPO Se Me — RA ERARO 进程 。 


. jld” 


PRA) UE IB AL, We = yu du CA) BF 


组 i 

Auv—vQ= 9 (17) - 
BAR, Mudou 17 > Aye — iR eh ie A, ae 

Pia (AY = OCA) + OCA); (18) 


其 中 06 为 与 ;无 关 的 常数 。 如 时 2 流出 或 日 然则 由 于 和 入) 及 入) 
的 范 条 人 性 ，2= 0, He 2》 是 唯一 洲 足 向 前 方程 组 的 人 过 程 ， 证 
毕 。 | 
注 inka, =0, MC4 Pie, =0, BEM ee E By A 
任何 过 程 四 和) 具有 形状 
Yh) = BA) avi ChIPIN) + FO, (19) 


FE PRA SO, POLE ea ATLAS PPA HO. AD 
ye JE Ted By 7 et 4 A AOA AB R18), 


$5. — 4E 5| Jf 
后 我 们 简 记 
KICA) = ik), XIA) atz, i" “1 
1. Fol2~2i) ye ulr Z) +1 
'  a.(Z-2,)+ 17’ f G,9(2-2,)+1° 


(2) 
BPX + X?=1, Ald. 6 MA 
AG(AL=1-X'(A)— XA, | (3) 
引 理 1 XM CAMG=1, DEAH, E. 


XALO, XI 一 全 如 ;一 0， sca) 
Ggs mi=o, 


KYO AX CAO, Gt). (5) 


APX = Xt- XK), @=1, 2, (6) 
证 ARES) Bay, “40, = 0 时 ，(6》 对 &=1 显 然 ， 对 5 = 
2 由 (3 引得 出 ， TER >O. 
Hz =c, MX? = 芋 2(A) = 由， 瑟 ! = 1， 同 样 由 (3) 得 (6)。 
如 果 z< ce， 则 


dD, Pi ANZ za) 


= YN) D MeO D (tae a) 


i=0 fai 


oo 


THA) D AOM © (Zar. ~ Ze) 


fuadtl hej 


= OS ~ 24) Shu, (CAD + > (24417 Sh 


= r= b=ort] 


x =e, Ops | + wah) 5 (Zei — 2) 


hots. 


x > Av, ADB; 


i-itl] 


=v) Suc. au ECA) ~ wt, AY 


hot 


+ 5 Cees -za Aut) 


Å-i+i 


FEO) D Grm Zovi ~ HCA) I 


下 一 人 十 于 


= {> City, CA) CAJITA- Ziga) 


ÀA =i 


-u IAZ- za) | 


Å-~-i4l 


tuof S Lv 1 (A) 一 VACA] —V GCA) (2 zia) | 


. 了 了 看 a 


HV hd fu CA) a (AVF RTCA 2 
| — IH lA) — Za} 
+U;(A)(VC2, A en O — VEO) = 2} 
= [F Avi CA) — Hi CAY HASC — 2,9 — Last- 20) 


+ I]v:(À) 
=(2-2:)-[a,(2-—25) +IVA) | (7) 
PIS 21 1 的 (6》 SR, HEAGA = 2 
ase, Et, 


引 理 2 G) BX°MXMUMLILIEHRABDREA RA 
PRR. MENAR, X°=0, X= X?, 当 z 流 入 或 目 BR 
HX’ =X, ¥=0, E 

Gi) X'O) Ry ROX. MRE MRE, MAT A) 
BA ts HERR RX? 

证 由 十 理 2.5 系 ， 方 程 1.11.18 的 叭 一 线 竹 独立 解 是 
X? TX? PLGA (1.11.18) BYR. EX’ = cX*, N=eX*? Ce, oH 
常数 )。 

设 z 流 出 或 正则 ， 则 XX* 隆 0。 由 (6)， 

KOCAX? = cf X* C0]= 0, 
和 BA) =X? -X ONJE- TX (a), 
比较 (1.11.17)(1.11.19) 得 c=0，5=1。 

设 z 流 入 或 自然 。 悄 车 seoz = co， 上 于 时 X? =0, Ai tX, 
X=0,. Hao, MX +0, HAFX O) = 0,7 
(LD HEA, AXA) = OER HO. MC) 成 为 

AGA XR = KF 
由 引 理 1.11.2 中 六 "的 最 大 性 ， X?<X°=eX*, Hee> 1, 但 显然 
X! = eXia1, ioe, H pe=1, X°=X?’, 

A, WOOMERA SX, BAR. . oR, ws 
X?*— XO AC1.11.18) 满足 (4.7.21) RX RAL, 

—X°<X° 427 aR, X°=0, X2=K%, BX OH 


eyi/* 


Sr yEBRAR A X*, MTX! CA) be ERRAK., 

IMR ABR, HK (1.11.13), XCAR EIA RX! = 
1-XA° -X=X', 证 毕 ， 

引 理 3 + 


n, = [5i 如 z 正 则 ， ] 
[a(z 20) + Tn, WRA. | 
AA) = 三 | | (9) 
Gt; Hi 
utz, hy? 如 2 流入 。 


WPNE ATR, H 
ANGORA) = 7- FA), | (10) 
证 只 需 证 (10)。 由 (6 及 (4.5) 得 z 正 刚 时 的 (10)。 对 = 流 
A, H(z, Apsoo, W*(z, cc。 由 (3.7)， 
vi(z, A)=0, (11> 


_ 1 
还 有 VRA = TA (12) 


mE, PECAN, VOE, Rk 
O — AVEA) = UA Ev" Cz, 六 PICAN] 
= A) 之 NVA VN D Auth dis 
二 一 主 十 由 A-fF+? : 
=V (ANCU Cz, h)-UTA)]-+0 Circo), 
由 此 及 (3.6) 得 (12)， 
Hx, ROD (123, 


A Dy PAD 25) 
a 


i K-1 
= VCA) D Me, (Ae D> (25417 29) 
k-00 j-a 


ne Kai 
HCA) D AV CAS D C241— zy) 
Å-i+i ind 


+718 * 


i- 4 | m 
=w) S (Zj 2j? > At, (A by 
i-o 


R-:41 


+u ` (2341-23) > hth iby 
i= 


Řai+l 


+ E aa) © AVi | 


T=j4i k-i+ti 


j- 1 . 
=v) D (2341-2, [uF ut] 


了 一身 


| D ri aE (2h) ~ VEO] 


+ DY Cz), OO] | 
feria 
= PAUTA CZ; = 2.) CHCA) to Ch) T} 
HAO YIA Z zad L Eviz, A) Ya CAD} 
= A) {TCE 20) — Hith) + TF 


HODA VEA) Ce = zo) ~ rR FD} 


= [H Ayvi (A) — a (AVECAD CE — 29) + ViCh) 


2 fee ya hy D 
miz, Ay S74 Zaj v CÀ) u'z, A) 


所 以 由 (4.5) 及 (6) 得 00, EE, 


引 理 4 91()G>0) 是 行 协调 族 的 充 要 条 件 是 有 下 列 Riesz 表 
现 ， 


qa) = ph) + daa), | (13) 
Hihazofied(h) ET， 常数 d 宇 0，z 流 出 或 自然 时 d=0， 而 


x? CA) uy ONZE i), 


Nw) =) aua (14) 
(sao ,如 2 流入 . | 


证 ”因为 当 且 只 当 z 正 则 或 流入 时 ,2; 含 非 零 行 协调 族 ?(X)， 
* 了 19 。 


BEIER. SPAR 
引 理 5 Bee. Wy 
UF SALMA), AT] 人 Ce Af co, €15) 
Ta 2 


1 一 二 
ri T Tte. (16) 


证 〈1.11.40) 现 在 成 为 
ACX? (Aju, X*] — VR (vip, X= -LK CAE, 
Kv ]=A-v(X* (wou, X*(A)], A, vied, C17) 
由 此 得 Ui 的 单调 性 . 
RA HORA., 
CAPCANA ]i = AVTCA) Su, (CAJA GBG 


上 到 心 
+ ARF) > Vi CA)X Thy 
po bad 
x [X1] -—LX CATT, 
EEG. D, EEA PAi cof 
-U$ = [Xr te) ~ LEXA Cz), 
由 (2) 得 
14+ 一 _ fo _ 
pat jiz) = mlz- z, Fl 
4 _ Ty 
Lx J(z) = a e-z yl’ 
w ERR, RRE 
limLX (4) ]* (2) = 90, limEX? (4) ]*(2) = 0, 


(18) 
TWX A Mie 4.7.18) (4.7.19) AREF. TES. 


86. 满足 向 后 方程 组 的 怠 过 程 的 构造 


由 定理 4.4，#* 流 入 或 自然 时 ,满足 向 后 方程 组 的 Qui EE, 


«720 * 


A SRA ER Ezy h REM, mzao, u, Aao, 

由 定理 4.4 的 注 , OREO EBAY AA SYA 
有 形状 ， 

Beh) = GCA) + XT OOF, C1) 

APA) 宇 G。 因 此 满足 和 同 后 方程 组 的 8 过 程 的 构造 问题 已 
STEH 2.2.1, 当然 ， 在 生 灭 过 程 的 情形 下 将 取 更 具体 而 简单 
的 形式 。 
此 时 ， 定 理 3.2.1 pi H= {0}, nO) X dX Ade, 而 常数 


d 宕 0，2z 流 出 时 d= 0。 其 中 前 Yi = dt = day 注意 


@,(2@-2,) +17 


根据 引 理 5.2, X°=0, X=X*, 因此 定理 3.2.1 现在 取 下 面 形 
Ñ. 

定理 1 设 z 正 则 或 流出 ,以 ) 是 满足 向 后 方程 组 的 过程 的 
充 要 条 件 是 ， 或 者 YA) =p, REVO 可 如 下 得 到 ， 取 行 锋 
量 o 汪 0 使 a6(X) EZ, KE Bd=0, 当 z 流 出 时 d= 90。 并且 


AA) = ath) + dX (A) pre (2) 
取 常 数 c 满 足 
e=:(a,X!]+ da, (3) 


a Z= 2) +1” 
其 中 "C9=1，2) 由 (5.2) 确 定 。 最 后 令 
bh) taXi Je; 
H = Bish) + KI WO SET Xe rT A RCN 
(4) 


tL REY CA) ARH 断 的 充 要 条 件 是 =0, c=0, HEYA) 满足 
阿 前 方程 组 的 充 要 条 件 是 =8。 


87. 满足 问 前 方程 组 的 QR 过 程 的 构造 


由 于 定理 4.4， 我 们 只 需 考虑 = 为 正 出 或 流入 。 由 于 OM 
多 (请 足 辐 前 方程 组 当 且 只 当 节 人 有 形状 (5418)， 即 


Tite 


His (A) = Bi OY + Fi), (1) 
其 中 79) 由 (5.14) 确 定 。 因 此 ， 满足 向 前 方程 组 的 Q 过 程 的 构造 
河 题 已 在 定理 2z.4.1 中 解 次 。 
HREN. ER IOO =X? Ok， 按照 定理 2.4,1 中 的 记号 ， 
或 者 2(%) =0, 或 者 ECX) = XA), 
MAE CA) =0, Wa Han), X sU AU = +co， 这 与 
(2.4.3) 溃 突 ，。 因 此 必定 2a) = XA), Risso. FEI RE AD 
考虑 ，(2.4.3) 中 的 kk 必定 为 6071!。 根 据 (2.4.4)，P 志 0. NV = 


U! = TG EST X =00， 因 此 如 果 用 常数 8 代替 由, 刚 定 理 
2.4.1R TRB. 


定理 1 TEN. YO) EIN By BO 过 程 的 充 要 条 
Pe, REVO) <6), REVO DM ESR, ARGUE 8 及 
EMM, pcs, MAW 


G-Data 
a, íZ- z,) +1 Ze (2) 


[ BX} (A) + OXF (A) 1X} (ADI 
CHACX (A), PRE! 46X24 ° 

ja REVO) RUE TEE RPE EG > 0, B=d, c= 0 或 者 ao= 
0，c = 0。 过 程 %()) 满足 向 后 方程 组 的 充 要 条 件 是 ae = RA 
>O, F=0, 

MEARE Ry BA OMA, SRA 
定理 2,4.1 导 出 、 但 我 们 将 按 下 面 方式 进行 . | 

假定 z 流 入 或 自然 ， 此 时 xtz，X) = ce。 如 果 ao =0， 则 最 小 
解 不 中 断 ， 台 过 程 唯一 。 因 此 我 们 进一步 设 Gu>>0。 于 是 《5.3) 
成 为 


a Pip lA = ay, +- (3) 


APCAJL=1—X' (A), 
MiHB(4.19), EMORY) 具有 形状 

BCA) = Oi (A) + XTCADB (A), (4) 
FUG, JIN Oat RE Ate E2, S. SAR TB 


* 7220 


由 于 VC) 的 下 降 性 ， 

SuPXT(A) = TV ALL (5) 
因此 ， 遇 于 zx 自 然 因 诈 夫 流入， 根据 定理 2.3.3, QQ 过 程 唯一 ， 
如 果 z 流 入 ， 情 定理 2.3.3， 每 个 非 最 小 8 过 程 由 定理 3.3.1 


得 到 。 接 照 定理 3.3.1 的 记号 ， 此 RO = da 人， 常数 d>> 
0. ig 


Y, ARA), 11 = rt EN dee 


_ da, 
Wa iy [utez h) Hui CA T=d- 一 HY 


aldeco, py (2.3.5, ine=0, MAEL, 1]=%. HP 
H32.. RRM ea RTE., AEDE e=0, M d>. iX 
tE, A2.. 1 Pit O RR nea. WRH o Rame 


al 
2.8. 1H BY ° 4 7 it} 


o+dh RCA), 1- X j= THARA) ID, 
WEHRT, WE., 3i FEE. 
定理 3 AH, a0, MWER, A. AM a = 
0, WORE, wm, METOE R EAA EE, 
WEREYVO)=¢G), RË 


a XOR, CAD 
Wil A = Gi lA) + SFA 11° 


(8) 


其 中 常数 oO, AA) = NOOR SER YC) 不 中 断 当 且 只 当 。 
=i, 


88. 不 满足 向 后 、 向 前 方程 组 的 QQ 过 程 的 构造 


当 z 流入 或 自然 时 ， 上 节 已 研究 过 了 。 我 们 假定 2 正则 或 流 
e 了 了 了 


H. EFi #* 09 时 任何 9 过 程 都 满足 向 后 方程 组 ， 因此 我 们 进一步 
Ha, >0, 
根据 (4.19)， 每 个 怠 过 程 #(x) 有 形状 
Big(Ad =O pA + EPI) + XT OFC), 
| (1) 
Here P(A) SO, Bye H81.12.1, ALFA), 21<1, 
我 们 将 确定 Fa=1，2) 使 PREM eA) 满足 范 条 
件 、 预 解 三 程 和 & 条 年 
SURO) 的 范 条 件 成 立 ， 由 (5.3)， 即 
KIMMEL (A), L]4+X2(AALF2(A), 11K! (A) 
+X (AJ, 
dico, YRA A =0, XC, A) = 1 得 LF CA), 11s 1. 
RE, WA eS 
Fea) =O, ALFA), 11<1, @=1, 2, (2) 
RMU A KR at FE, POA) RO BS a 


FAAC, v) = Fv) 十 《一 大) SFA), Xew] 
下 CVD) (3) 
(G=1, 2, 4, Vd) 

(一 ) HRM poo, Fio) F*wRtee. TRÆ 
四 章 § 3 的 讨论 几乎 仍然 有 效 ， AR TEI S WR 我 们 叙述 成 下 
mE. 

引 理 1 Ber EU RHE, FA) (C49=1， 2) 对 革 个 (从 而 一 
HI)’ >ORPEMIX. 

为 使 41) 中 的 mk) HRSA BRR, RK 
BPA) =O), RAPA MIP BS, MBBS 0 《G= 1,2), 
d,+d,>0, p20 GYLMNIP=0). Ripe Eeo i ap) cz, 
H 

AD =a) + pX? ARO, (4) 


= ]24 + 


如 果 G >da, MER 
[a, X*]<co, p=0, | ‘5) 
取 常 数 c 满 足 
c0, td, =d,, 
ee (d,~d,)W,, Bid, >d,, : (6) 
e=(d,—d,)W,, ind, <d,. 


= wry Feo _ 
其 中 W, =Le, J+ a,(2-2,) +1" (7) 


W, =[¢, X?]+PU", 
最 后 令 


[qd XH) +d, Xj (Ad IN (A) 
ig) = bis (A) +e SAL QCA), |X! +d,X?7] ° 


(8) 
E OER Bese 4.9.1, #5 RRS R 
W, =limACy(Ad, Xi} a, 
因为 依 引 理 1.11.4, W ERREA RN. 
ATS PEO LOWE, WA RILORT, Bp 
limAXj AF (A) = 0, G=1, 2, (9) 
HH (8) (1.11.26), 
: a _ df; 
Eh. OG. D, (OM Be=1, t= 0 以 外 成 立 。 对 4=1, i= 0， 
C9) 成 为 


i i ----- 一 0, (11) 


现在 设 d, >d 0. HG W,=[e, X<, p=0, 
HG), e0, LMA HEEB HW <o., A112 A BE RE, 
By Ub ed, d,>0, 

RF, ORA 

c>0, Wd; =d;, 
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e=(d,—-d,)(Le, X']+ aan) mdi <da, ] 


(12) 
(11) 成 立 的 充 要 条 件 为 dia=0, RAW, =o, HFa, X']< 
Wico, PERERA 
d,a=ORtp>omp=0, [a, 1]=%, (13) 
我 们 得 到 下 面 的 . 
定理 2 EZIEMSR RM, ¢.>>0, Fe(A)(a=1,2) 线性 相关 ， 
7A EL) BA EB PAD ORD FESR, MB HCA) = GA), 
RAYO AR PBA: Mettet alc’, Ret d,=d, 20, 
d. >0, p=0 《流出 时 D=0) Ke AEDA., $ 
Pip = AA) 
Cd ,XIX +d X71] E mba) +PX O) pz | 
y c+ > dh {Eia X XN) + pAL A? (Ade, xo] } 


(14) 
TERPISAH, = 中，c=0， 过 程 不 满足 向 前 、 疝 后 
方程 组 的 充 要 条 件 是 d; >0，os 0， 
BAVA EWE, ARORA M- 得 B 条 件 等 价 
于 


0= M- OLX} OFO) +X OEF A= f 
ATH C1) PH AL — 0) 4B PS Phe tp 


O= [XG CAMP (AD + XU (ALPS ONNA- Q) 


id, X} (Q) +d, Xi) Ja; 
CAI) dX! +, X*] ° 


而 X A), KOA) 线性 独 ae, Hed, +d,>0, BI mi dX O) + 
d X (A)=0, | E 
(二 ) 在 (一 ) 中 假定 了 FA) ly2》 线性 相关 。 现 在 假定 


+ 126 + 


0 W>, 
a Fic, AiO. 


Fk) (G=1,2)8E+( MT ODA > 02805 the 

此 时 可 区 仿照 第 四 章 § 10 的 记号 和 讨论 ,特别 地 , 引 理 4.10.1 
作 显 然 的 伺 改 后 仍然 有 效 。 

引 理 3 议 多 xD) 为 忍 过程 ， 形 如 (1 。 则 存在 行 矢量 吧 关 0(c= 
l, DH ge 中 (X) E E， 存 在 二 阶 方 阵 #1=-()) 20 及 数量 Piso 
CG=1,2)(Z 流 出 时 [LP;] = [01 {E 


[CFI= # Lob +(P IX NY, (15) 
引进 记号 

hi*=ALarb(A), Xo] 一 [aa ,成 5 ~ KECA] fhe 

= [æK], Ato, (16) 

He, = (hl) A a = hh), Af oo, (17) 
考 虚 一 特殊 情形 ;， [n] #-<oo, H 

(F(A) ] = Zap], (18) 

Lear, Eo, @=1,2, (19) 


定理 4 设 ? 正 则 或 流出 ，a, 半 0。 任 意 形 如 (1) 的 Q 过 程 C3) 
As Ti] REE 18), CLOT PCA (a = 1,2) 线 性 独立 ， 

证 yoni QA, Hina), (199, BPA) (¢=1,2) 
线性 独立 。 

RHE 4.10.2 一 样 ， 根据 YO) 的 范 条 件 和 预 解 方 程 可 得 
[FOO JA JER. 10.33), EH | 


[F(A I= U- £1)" eA], (20) 
hatsetan, 12<1, 715{La, XAT}. 


POORE MEOS tF, EI 
0 = MALAXA YhEPCNY 


vem ie 


Boh HG. OG DEP HK Oe se BE, 


= lmA XQ) FOARA D 


lim (2-7 *)7} = lim D7 t=. 
A os A 


n-o 


a }2/ + 


C21) OPE O FE RAA. PE 0, CORA 
_ foe 二 i 
o=( 7) (@]=4,8 7 


于 是 如! =0, BODEA) a=1, 23) 线性 相关 ， 证 毕 ， 

注 ”、 从 证 明 可 见 ， 按 (20)(1) 确 定 的 和 %) BATE OE, 
HAO, BPR; =9:;0>0, FOB), Go, =o; + 4,4}, 

HER ECD PR A 

引 理 5 zihet Em, a, > O. Be F(A) Ca=1, 2) 线性 
独立 。 为 使 (D 中 的 oO) 满 是 范 条 性 、 预 解 方 程 的 充 要 条件 是 
(A) 可 可 下 得 到 ， 取 非 负 行 和 所 量 ca=1,2) 使 aca) Ce, Wak 


MEEF (0°), mM OCT UIA =O, REFAH 


质 ， 
(i) RAB Oo, MBP = 0a Ha’ eee phy. 
(li) Reb colab), 
(il) mE, Bl<, 


gtl, 


gat fee 十 Bo. (ab) 
a z= z) +1? . 


BES. [I= (pe): 
P= + LLUN, | 
[pal=U- #4 +8 ,4+0810U,7)- 051. 
TOPO REC), O5. CDR E., BCR H = (hI) A # = Ch) 
(A + seo 对 可" 按 人 (156)7、(177 确 定 。 FRCS. 15), (5.16), 


[UI = UUD AUN = (—— 


(22) 


Taz- z, +L? +00), 


(23) 
PO) AIR Gn (18), GD BERR ee Pe =0, 22? 
<00, 
证 WHE. SHEN, REIRA. Ba 


» JZ8 4 


HOR, ASML. 11.4, ina Sokar, MA = limk; 
eo, DES. 

考虑 下 迎 5 中 的 (NA) 是 人 这 程 的 条 件 。 由 定理 4， 恤 类 
| «BR > ORR eht = 00, (24) 
fv ORE, MRBIEOR YH, E 
lim [AX (A) ]/ ET AAPA] + [PIX (AH) =0, C25) 


其 中 r= F + [FU 1") 
N 1+ At} — B12 4+ AEs 
SÀ ge ita peu 1+ hi? +p Ui ). 
HT (24) Ra] MS ili), limderz, = +00, EAA eco, htc on 


(a&b), we 
14 434+ PU; oth BS pit y 


lim #7! = lim A ( 
4 


joc det giz Āri 1+? 
(OPENT y 
0 0 和 


由 于 (5.4?，(《5.53，【《257 对 ?20 成 立 。 对 != 0，(325) 左 方 极 


限 为 
Toy y 
(, (, 
WA eC 25 ear, 4B A Ma! =0, 
这 样 ， 依 (232) {15)， 
1 Q | 
PROD TS 2% larga + BEX? (ADD 
页 Fe(k)Ca=1，2) 线 性 丰 关 这 与 FA)(a= 1，2) REM 
, PHO (25) 70 By ABR. 
结合 定理 4， 我 们 实际 上 已 得 到 下 面 的 定理 ， 
定理 6 PEW HEH, 2,50, MR PEOL ER $A) Bin 
(1) HFICA>, F OOR RE phar, 


(1+4!) 0 


#729 


注 ”从 定理 前 而 的 论证 君 出 ， 下 理 5 PERY C24) 的 
OCA) ROR TEE, (HAO, HP gid (i>0, EE), 


Qo it GERT 


$9， 关于 a$(4) Er 的 条 件 


Beret, (5.3), edA EI 等 价 于 


Sal- XI -X O<, (1) 
AR A A ORAR (A) EI 的 条 件 ， 
引 理 1 设 ao 关 0，* 正 则 或 流出 。 则 
VEAD 1 
i o ez, “(za . (2) 
证 利用 (3.4)， 优 引 理 4.,11.2 证 明 ， 
引 理 2 po, =0, ZED. W 


Ym OA AAI TX NY, 1], (3) 


证 仿 定 理 4.11.3 即 可 证 明 ， 
定理 3 设 06。 之 0，z 正 则 。 则 te6(%) EEROLA 


是 
Patt) (4) 
o 
或 等 价 地 
i SaN, (5) 


i- 9 


这 里 Nj 由 (2.8) 确 定 . 
证 和 刹 用 引 理 2?， 仿 定理 4.11.3 即 可 证 明 ， 
定理 4 Peo, 0.2K. Modis) EE 的 充 要 条 性 是 (5) 成 立 ， 


ss 130e 


有 


证 ” 仿 定 理 4.11,4 即 可 证 上 明 ， 
EES He, >0, HARA. m APA E E My 4pm eek 
Èe Loo, (6) 
证 必要 性 从 
1-X¥(QA)21-X10Q)>0 0) 
得 出 。 芭 分 性 是 明显 的 ， 
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第 三 篇 ” 马 亭 边界 及 其 在 
构造 论 中 的 应 用 


RT ” 马 襄 边界 和 QQ 过 程 


$1.51 言 


当 人 过 程 不 唯一 时 , 为 了 解决 妃 过 程 的 构造 问题 ， 必 须 对 状态 
空间 王 进 行 紧 化 ， 即 必须 附加 一 些 “ 边 办 点 ”到 B 中 ， 恒 得 满足 某 


EK, RAS, Ril BSBA 过 程 的 边界 。 最 简单 的 ， 


时 化 是 将 号 单 点 紧 化 。 例 如 对 单 边 生 灭 过 程 就 是 这 样 ， 面 且 单 点 
RERET. RM, 一般 说 来 ， 仅 仅 用 单 点 紧 化 是 不 够 的 ,例如 ， 
对 于 双边 生 痰 过程 ， 我 们 显然 要 用 两 个 “点 ”来 紧 化 EE 

Feller 2) ESET- RUM RA. fh [3] 
中 对 保守 前 8 引进 了 流出 边界 和 消极 边界 ， 并 应 用 此 边界 在 流出 
边 略 和 流入 边界 都 腿 的 情况 下 ， 构 造 了 同时 满足 向 后 ， 向 前 方 
程 组 的 全 部 9 The. He A Fe Sa} TR. 

Doob[L2] 中 引进 了 马 氏 链 的 蕊 享 边界 ,其 特点 是 紧密 地 结合 马 
FO SEA Lae. AL Sie BA HIR a LIA ES A A OE CE 
Hnskusal3), Hunti], Watenabel1, 2] BRA BS wat 
Mt — HF SS SEA RK. Kurita PEARSE ARNA 
过 程 . 但 在 上 夯 的 文献 中 ,都 是 在 马 氏 链 上 加 了 一 些 前 提 限 制 ( 例 


如 ， 要 求 马 氏 链 非 常 返 ， 至 少 有 一 个 “中 必 ”) 下 展开 讨论 的 。 这 


a 732 + 


i 


{MT el e 


些 前 提 条 件 盟 然 是 非 本 质 的 ， 但 却 需 要 解除 。Hunt[11 中 关于 标 
谁 测度 的 引入 可 以 解除 有 一 个 “中 心 ”的 眼 制 。 Janearl3, § 9] 
中 的 式 于 

K (i, 门 = Gii,}) 一 fiz 


¥rG (sD r,s 
ğ A 


RETRE ORES HSE AYER AUIS. RIKEN RER 
加 限制 的 情况 下 导出 了 蕊 亭 边界 ， | 

本 章 中 ， 我 们 首先 引进 一 般 的 马 氏 链 的 马 亭 边界 ， 其 详细 证 
明基 本 上 仿照 Tarakaa[3]。 然 后 ， 我 们 紧密 地 结合 & 过 程 进行 广 
泛 的 讨论 ,我 们 利用 Felier[31 中 引进 的 标准 映 象 , 它 与 定义 1.11.“ 
一 致 ， 但 较 狭 窄 。 我 们 引进 并 详细 讨论 了 入 映 象 ， 仿 腿 kunita[1] 
中 的 方法 ， 我 们 导出 了 不 加 任何 条 件 的 2 EP AS ae a 
消极 边 界 ， 并 应 用 这 种 边界 对 第 一 章 § 12 中 8 过 程 的 一 艇 分 析 表 
达 式 作 了 进一步 的 肇 划 。， | 

ARG AA FRA REO 过 程 ， 或 者 深刻 理解 
8 过 程 的 分 析 方法 构造 ， 都 是 非常 必须 的 ， 而 且 是 基本 的 。 


§2. SR 


BECL, FP) ASE RS, Bye EM RARE 
整数 及 “co "的 随机 训 量 。 称 和 rr{) ={2z,(@)7>, ass} (@e Q ny 
非 抽 整数 ) 为 定义 在 概率 空间 (CO, FPP? 上 取 值 于 可 列 指标 集 
B 的 齐 次 马 氏 链 或 简称 马 氏 链 ， 如 果 对 任意 整数 4 盖 2， 非 负 整 数 
Ot <t p< <i, AER, stats tna CE, Ae Plx( i.) = tay 
ixaxn}>0, RA 

P{2(tes1) = bon ECE) =, Lacan} 


DASE eT Boris, MHRPZALT H, TAM, 
D BNRaeohoc(t,@), HERP R ROM, Maa, 
Ki, . 


e735. 


= Pla(t,..)=t4,/204,) =}, l (1) 
而 HA X fet HRX, R5 t, 417 Fa BE, 


记 Pi, = P{x(a) =j|2(0) =i (2) 
PB CP) A MO Re Be, BP; = PTs, 作为 矩阵 ， 
KP] = Pu" (3) 


Pa (pi 非 负 且 行 和 不 超过 1。 每 一 个 这 样 的 矩阵 P 都 可 以 作 
为 菜 个 马 质 链 Xzr 的 一 步 转移 概率 矩阵 。 因 此 ， 我 们 也 称 抢 阵 PA 
马 氏 链 ， 称 


| di=1- DriEE | (4) 
为 链 的 中 断 量 . iH fildi>0) 为 中 断 状态 集 ， 如 五 为 空 集 ， 


称 链 为 不 中 断 的 ， 否 则 称 为 中 断 的 。 显 然 ， 链 不 中 断 的 充 要 条 件 
是 | 


P{B=co}s=1, IEE, | (5) 
这 里 以 及 今后 我 们 记 Pi;{，}=P{l* z=}, E:{-}RRRKF PMR 
ese eS, pin a 
EA, A} =Eif1, = 1 ,fdp. | (6) 
1,aean A RU aR TE | 
4 qi*=inf{n|l<n<p, 2, =t}, . O C) 
ni =inf{n] 0na, x,=1}, (8) 


的 定 inf$= coo，4 为 空 集 。 记 


fi = Py" = ny. ; 
fis= Pn =n}, n n=], A . . (9) 
fi;= Df, - Šin. 


Hær] ; 


Ri; CR PDA RtHRAR— CRE) 步 算 起 ,于 第 ? 步 首 达 ;的 
BS, BRADA Ai 出 发 从 第 一 (或 零 ) PRE. BAAD 
到 达 j 的 概率 ， 显 然 | 


e134 


Jt: =D, fir = fti), fi= fu, Mi=} 
fn=f?;=1, fii=OCH21), 
fi, = È Pafas, ff fija 
MURS; 01), RAITAA, 记 为 >j. His. ty 
Ris}, ji, PITH, iyi <=). ECCE, WE ChA 
二 状态 互通 ， ARAMERRCE- CA Pu = CiE Cc)， 则 称 忆 为 不 可 的 
类。 当下 三 Jf?1= 1 时 ， 称 状态 i 常 返 。 


(10) 


定理 1 ic 
Gap = Spt. (11) 
u= fF 
a 
«GUN =fEG,D, GO, D) = zr . (12) 
-rf 
RAH, AOE R JERE AEG O D= 0, 
ÔD SÖ, 9 (13) 
则 
Pi = £6; (2), Gf) = Ey dn, | (14) 
. : Ho ff 
id | | | 
Ans (09%), Cy Ab Bn AF, ty =F), 1 
出 | 
PAm = FT,, Pit Am, Lmee=F)= FF pF, 
这 样 
a o a 
GUI) = Er DiG) = Ey Sa, Da) 
"w= * -ù A m 


= > > El d(x,) 


mu i} n :mm 


= 5 S PreA,, Emih =F) 


Y= ü H =Ñ 


+ ] 35>. 


= 5 Eppadi. 


m=0åÅ=-0 


至 于 (12) 第 二 式 的 证 明 可 见 玉 样 坤 C1，8 2.2, H1], 
$. MP JERE, mM GG D<, Am ea ILE BRA 


Os) <0o, MUER, SECC SOR REA. 


定理 2 (KRATMMOMRED BLAMWRASME 有 下 列 
E=E, E (UE). (15) 


SPE, H—- UE RRS, WR, MR, 有 限 集 
RARR, HoE., RAELE OWA HRB, 
HEDE Cl, § 2.3, LI. RBH, BP PR 
态 必 非常 返 ， 即 
H= {i, EPis <1} CE. (16) 


BEXT = {x ，# 扎 B} 的 运动 情况 如 下 We, CRP Ecce x), Ill 
B = co 旦 链 将 永远 在 台中 透 动 并 且 无 限 次 地 图 到 BE 中 每 一 个 状态 。 
mAs, CE, AR A<co, Wen Ber, CH; 可 能 8= c, ERE 
或 者 未 远 在 已 ,中 运动 ， 或 者 在 某 一 步 进 入 某 常 返 类 下 ,然后 永远 
EE HES. ETHE 的 进一步 考虑 ， 有 下 面 的 Blackwel 分 解 定 
理 。 

& ,= (B=co), Q= (Poo), 

PACE, $ . (17) 


(A) =Q. N limsup{s, € A}, 
e= (18) 


FCA) =&,, f limnfin EA}, 


MSRP (A)} =O CB), 称 和 4 为 瞬时 集 ， 如 果 Pi{ (4)}>>0 对 


某 iEE， 称 刀 为 逗留 集 ; MRAHWOM, HH PLLA) } = 
PZA GECE), FAWILE MR. SAARNA P A 


中 [36 « 


| oad “Tt FF | i 


nt, RAFU RRIAZ) AAP SREB OF —UD y 
任 一 集合 . 

BAA IPA, MWRTERBCA, RAPA, MA 
A-BRRI ER, WRAy ETILE. MRH HER BCA, BR 
AAT ILE AS, WAR SSIER TILE RIA. 

下 面 是 布 勤 克 韦 (Blaeckwell) 分 解 定 理 。 

A3, (Chung[l, 1$17， 定 理 4) 

状态 空间 EBE 有 下 列 分 解 


E=A,+{\j4.. ) (19) 
FPA SSSI TIL PAB, WOR. ow SR ARE 
BRA] FIFLPRB, HOC Ww, 4,006 MOBRTILERR. WE 

PL Y(A,)} + DS PL H(A} = PR), (20) 


除去 瞬时 集 的 差别 外 ， 分 解 (19》 是 叭 一 的 。 
注意 ， 分 解 (15) 中 每 个 不 可 约 常 返 类 都 是 原子 几乎 闭 集 。 


83. 马 襄 边界 理论 


为 了 研究 马 氏 链 Xr = {zx,，n 志 有} 的 轨道 的 终极 性 质 , 即 当 n18 
时 zx, 的 性 质 ， 产 生 了 马 氏 链 的 马 这 边界 理论 。 应 用 边界 理论 还 
可 以 刻 划 与 链 相 联系 的 一 切 过 份 通 数 和 调和 函数 。 设 Xr 的 一 步 团 
移 垂 阵 为 P (os), WR PRAMAS, MRAZE, ES 


Paal, Pa; =9, Pia=1- bP, ICE, (Do 

Xn = A, WRAL, n> Bp, 42) 
Wir n=O} 是 马 氏 链 ， 一 步 转移 概率 为 【有 yy， 六 EUTAT)。 
今后 将 总 蚌 这 人 么 理解 。 


(一 ) 过 份 函 数 和 过 份 测度 
BUH ELM, Baw yee. 


D 从 后 册 也 写 光 下 5 SEH, Pw AS, pes, 
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(Pu) = Dd sts, 
Bev E E RE 测度 YP 如 下 给 定 : 
OP); = 2% Pis. 


定义 1 非 负 ( 包 括 + oo Raua PRR, WMAP, FR 
为 调和 的 ， 如 时 了 =u, ARAARA AA. MFR 
药 调 和 函数 类 记 为 .f (8)。 

BA, Medi, Musu — ie, 

E2? 非 零 过 份 (或 调和 ) 函 数 4 称 为 极 小 的 ， 如 果 =u 十 
uw? ,上 且 w! 和 Ww* 是 过 岑 (或 调和 ) 函 数 , 则 #4 = ecas l, 2), eA 
非 零 调和 函数 & 称 为 完全 非 极 小 的 ， 如 果 对 任意 非 零 调和 陋 数 ? 专 
uy ?都 不 是 极 小 的 ， 

定义 3 ‘ 非 负 ) 测 度 4 称 为 过 份 的 , WRS 称 为 调和 的 ， 
WRAP = p, | 

Huergo mA. PbEU =0， 则 (C4, iC EL {ARF 
(Piui EEU {AD BAB. AX MSR Men ote, 

ECU Euri) 205 Ris Tn = Ble s,, 19/2, 
= EP, ji SUG), | (3) 


P(w), n= EER, (2u), noe FRAC ADE RE), 
Am 

Eu(x,) REU x, = Eua, ) > (4) 
设 0 达 a<5， 令 Uw 为 序列 W(x0),…，wwtxw) 同 下 穿 过 区 间 L4,581 的 
XA, MAEKA GRAS AES ARA m EAE LUT), 
…，~u(zw) 自 区 闻 [-56， 一 和 的 在 方 到 右 方 的 次 数 ， 依 王 桩 十 
[1, § 1,4，5 引 I 理 3,， 
| FL ~ (ay) —(-8)1* 


EU y< 
7 (一 的 一 (一 中) 
~ Flaten) -bT _ Eulen) 
一 bla 


-4 m 


| J38 » 


a Eiza) 

b-q * 

4Sv¥gk(eo), Hri), eoe … 癌 下 穿 过 区 间 La，D] 的 次 数 ， 
网 Vx 4 ¥, 因而 


By ee | | (6) 


(D) 


K Bt] Hs 


Ewa 4 . (7) 


Eie, Wua, WME, fen ILA y<co, Butz), 
roa FRC Ocak ea. A IR. RA T 
ek EEE Ay a AD BIBI, Oy i BRR AB, MER ah ee TE FY 
的 或 无 穷 的 极限 。 因 此 ， 如 #( 让 之 co ， 则 在 在 极限 


点 = limu(z,), pi JLE (8) 
但 是 

Enea) = py wep <uci), 
故 由 法 都 引 理 ， 


TD 
从 而 产儿 乎 有 < 。 我 们 实际 上 已 经 证 明了 下 面 的 定理 。 
EM) kepi, HO, 则 在 8 上 ， Pi 几乎 存在 
AR lim (2,), 


定理 2 设 马 氏 链 的 状态 互通 ， 则 链 为 常 返 的 充 要 条 件 是 其 一 
切 过 份 函 数 都 是 常数 . 
证 Batt. MBM AR) =o, DSH, 由 开通 
+E, #EnfEpi; > 0. Aig 
m> Zi ptu(kympt Mp) =o, 


于 是 # 三 co 。 丰 只 希 考 虑 有 限 的 过 份 男 数 &。 
BXH. HEM, FRA RR 
limar.) = 6, P, 几乎 。 
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Xr MERROW, HER, 有 
| pi(z = IRERE An), Eul. HTE 
E, WORARA, p(E=u(k)=1, Mite) = uk), Blu 三 常数 ， 
设 X? 的 一 切 过 份 函数 都 是 常数 ， aie, ius = 了 is。 则 按 (2.7) 
的 记号 ， 


2. Pitty DCM coo = ftps hin = ti, (9) 
好过 份 ， 从 而 # 三 常数 ， JE Egu, = fl, HUn, n=l 
MS ÅĂ— Bk, Ei], 02.10), 

1=fi;= 2, Pink mf 一 = 2s Pins 

f+: = a Pif a= > pi1;= 1, 

ERGE, MME. E. 
下 面 的 系 并 不 要 求 状态 的 互通 性 条 性 ， 
Rl iBEE., FFA Re eR. 
证 由 (9) 得 出 ， 
A2 ” 设 u 是 过 扮 函数 ， 则 w# 在 每 一 个 常 返 类 中 取 常 数值 . 
定理 3 ”对 任意 测度 ?7，YG 是 过 省 测度 。 特 别 地 ， 当 1 圈定 时 ， 
tt, 门 是 过 份 测度 。 


证 因为 和 = Se, is 


GP = Sr<G,(yG)p<yrG, 


定理 3， RW yi Dyfi > 0 EE),h 是 过 份 函数 ,如 果 有 为 
y 可 积 ， 则 jp 为 有 四 函数 ， 如 果 卫 Ya = 0 ， 则 R= 0。 
证 A pth<h, bt 
Vip} hs 2: 之 gh; < 之 Yi 


HAT YBBR, JEN, FEFEL ROE yp > 0, BOR Sih < 
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co, Mk; <o WEDA = 0, mh; = 0, 证 完 。 


(二 》 过 份 测度 的 密度 函数 
设 马 氏 链 Xr 具有 初始 分 布 Y!'', 为 了 强调 对 于 Y 的 依赖 关系 ， 
家 记 测 度 P 为 P,， 记 数学 期 望 F 为 E+:。 于 是 链 交 7 在 状 达 ) 售 留 的 次 


数 的 数学 期 望 为 9 = DGD. WE 


y= YG (10) 
是 P 过 省 测度， 
设 D 为 BE 网 有 限 子 侍 ，Ttp (或 简 记 为 T) 是 链 Xr 末 离 D 的 时 刻 ， 
pj 
tT=supin, Qana, x», ED} (112) 
MEn, tansal, WANED, MAATRE AE. 


ya 
Lp(t) = Pilt = 0) = P iz, E D, z, € DA leng), (12) 
Wie Dat, L562) =0; 4tC De}, LoG) 是 从 第 一 步 就 离开 而 
BAHAI BIDAR. KH SicDEHEW ER, Lott) =0, 
BR, Mite Ce, 


Pix, =f) = S Prem, Le = 3) 


= PHD =G, Diod), (13) 
m- 0 
Saa, Lp(j) = D PR DEL (14) 
由 (13) 可 得 
P(e, =D=n both, 15) 
其 中 站 = YE 。 


Henk ERER, Mat<on, Br >, 或 ?不 确定 时 ， PIJET, 
=A, pei, ,? Le. cin EE, 并 记 


D prc: WEY A SA, 


«747 


Rigs to) = Piste yo PC, stad, 


出 | 
Pix, = bg Tl =F yt ) 
= > P(t =m, Ln =tyoy T -1T byt Iman = by) 
= SPH EL Rdg t+ by Ln lig) 
=G RG, ,i Lolig), 
FELL Vif MTR A ES 


P(t, =io Te Ht) = NGI Ri, ert Lola) 
: (18) 
当 n =0 了 时 ， 上 式 化 为 (15). 
Sle EX MRT RS ERIE, EE LSE Hh Se, 
a wu(Ad=0, WRU = Nn, JCD 为 过 份 调度 ， 风 关于 测度 
PL, {4(2,_,) w20}KF{2,.. 220} 2 ER, Rp 
E Cuca, in) [Er pEr ip ty Eroin- JUL, nee 
(17) 
7 ATU. eK 


SUDA DIP i,t) SUC NG), 
i i . 


因而 
SNR, ,to Lo) eii) 


NR prt sbo Loli, UC, 
注音 (16)， 由 上 式 得 (37，。 证 完 ， 
5) HEATH AY ie i een Te RE. 
wK, HAE FAES) ASE ee ee, 
S=sup {E ulr, p) B ADCE; <, (18) 
注意 如 to = RTR, Tp =A, EUA, 
a J42- 


定理 5 设 链 Xr 的 每 个 状态 都 非常 返 , UC K, Bun Anh 
WHE, WEL. 上， Py UP FR liu (2,), 


证 Arun gt (2, C2, _) fal P Ee, 2] 的 次 数 ， Dp BU 
U(trow) sc, U(r, i Eo, OLR UR, BCS), 


E uix 
B, oy Bree) 


iF 

记 zp 为 8tzo) ,u(x,) 向 上 穿 过 [a, 8] 的 次 数 ， 由 非常 返 往 ， 当 
DEW, P+ 几乎 必然 r< ce ， 因 而 ww t ooN), A 
| . Eul, ) 
Evvp<— 
Alweck,, W 

Epc 
Fa Ave RU Ce) ba), ae), ih] Ee, 中 的 次 数 ， il 
vp fuCD ¢ BE), we yO 


E,v< €19) 


5 
b-a" 


因此 Py(tv<oc)=1， 信 而 Pr JPR TE Ay eC THAR, 
&=limu(s,), AP RRP, LPR E<, 


Hive) u(r, ), + UCz,)) + fe bea Ce, 201 HBL S 
limy(e)= v, BUR 
(E=-m)CCy 1), 
ii 了 了 (= 00) <P (7 S11) SE. 
由 (19) 及 法 都 引 理 得 
Py (E= 00) <E, limo(e) <limE, v(e} 
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nS 
<= lim—= 10, 


È =+ op 


定理 证 完 ， 
(=) Bak 
定 光 4 称 测度 y = (六 ,1E) 为 链 Xr 或 ?的 标准 测度 ， i 
La Vi, O< D Yifiza (20) 


从 现在 起 ， 考 虑 马 享 边界 时 ,我 们 总 是 指定 一 个 标准 测度 Y， 
由 初始 分 布 Y 了 及 矩阵 了 = (piy) SPER AP,. AAP, = 


D YiPi, 夏 如 时 ?1>>0CiEE), 则 Py 几乎 一 切 % 等 价 于 对 一 切 i, Pi 几 
乎 一切 9; PERSE, PM, 


显然 
O< A= Sifu. | (21) 
SESS 称 
| : fa — Fi, 
KO,jy= = Fit l (22) 
A; Yf 
hy SE A H RR 
WERL AGU P= (7VG);GCE,), W 
Ki j = a“ 2 DD mick, (23) 


这 里 7 = YC，E， rer 由 定理 2 系 1 及 定理 3， 当 ji 固定 
BT, K(+,/) deat ts ae. 
RER C1IOPRA—R, BINA 
K(i, De-i, ,Kti,)) <> | 


C24) 
Tyg =1, 


定理 6” 设 /为 全 有 限 测度 。 则 在 8- 上 P, 几乎 必然 存在 有 和 
极限 
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lim ei) Ki, T). | (25) 


alm, SEB, ELE, PLP RRP AREER 


limK (i, 2). (26) 
证 C24), BHA 
2, HOKE, p< È W(t) AZ) oo (27) 


设 五 为 不 可 约 常 返 类 。 当 考虑 也 的 类 性 质 时 ， 可 以 把 已 中 的 
READS, PL ARABS ARE. 当 7 CER, fiu 
SISK, WHA), AMKGDBSICE AX, WAKO, 6). 
因此 ， 当 链 于 某 一 步 进入 某 不 可 约 常 返 类 Bo 时 ， 对 一 切 充 分 大 的 


B, 


> HKG, 2,) = DH) KG, E<, 


因此 极限 (25) 存 在 且 有 限 ， 

AT LEA: Miz. EE。 对 一 切 n 志 B=co 时 ， 极 限 (25) 存 在 
HAM. 此 时 只 需 考虑 Be 上 的 非常 返 链 Xr = (2,,n<8}, 其 中 B 
= sup{n: %,€E,}, Xz 的 初 给 分 布 为 (Yi， ICE), PRB ER 
为 P= (py, i, PEE), MEP, ER Tu= tu KG, D=KG, 
DCG, ECE, ), WH 

2 POKG, j= 2 nd) KG), EBs, 


En 


EL, PiE. BP = (Dizi) CED YEA RAS OH, 
HE HA (25) 极限 存在 且 有 限 。 
4 uti)= Z KDEGD, 注意 (23) AunenG, MeO E 


份 测度 ， 往 证 CK,, RL, AAD, 
E u(r, y = 2P, (2, =u) = FUIL 


= > HOGG YL), 
1 ,1 
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APC 14), 


E ulr oa + Dy HL) oo, 


从 而 
sup{E u(r, )， ANDES < HeD, 


Hin cK,, ARER IGEA. GEST. 

(> Beis. 

在 蕊 亭 进 界 理论 中 ， 我 们 将 不 可 的 常 返 类 忆 中 的 每 个 状态 者 
等 同 地 视 为 同一 状态 忆 ， 并 仍 记 


EB=E, UE} | (28) 
(20 p AEA HEF.: B= {@,,€,,°"}, TON (Em) = 
+ . 
da, 7) = -we 一 28 
+ D> |K, D-K, j AQP (29) 


其 中 4 由 (21) 确 定 。 则 gd 是 E 中 的 上 距离 ，d 在 B 中 导出 离散 拓扑 ,而 
Addi, <3 CG, (CE), REA IHES SW BSc eR ZN 
E*. | l 

EMG FOE =E*—E, 为 链 P 的 马 亭 边界 。B* 中 开 集 所 产生 
的 波 雷 尔 (Bore) 域 记 为 ee*。s* 中 的 元 素 称 为 E* 中 的 波 雷 尔 储 ， 
定义 于 波 雷 尔 集 F 上 的 e* 可 调 函数 ， 称 为 上 的 波 雷 尔 可 测 函 数 。 


BA, 
dE = (dE), U (QE),, | 
(JE), = {5,0 E #}, (dE), = (3E) — (dE),. 


从 距离 4 的 定义 显然 有 

定理 7 王 中 无 穿 序 列 {j,} 是 距离 空间 中 的 基本 序列 的 充 要 
FFE 

D MNG 48 FE CAT FRES), 


| (29,) 
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Gi) 对 每 个 1EE,{K(i,j,)} 是 实数 柯 西 基本 序列 ， 
由 定理 ?7，N() 可 以 将 定义 域 E 开 拓 至 B+ 上， 因此 
NIS) colSEOE)), NC) =e (EEC (ðE), ). (30) 
对 于 每 个 让 KOFA IRGAT ESE Ie BE*, Bp 
K(i,8) = limK(i,7), 


Ss 


由 (24) 及 法 都 引 理 ， KC +, 6) Feit Ut , H 
KODS- ， 2K, £)<1,£CE*, (31). 


C24) 忻 为 (31) 的 特殊 情形 ， 上 而 第 二 式 对 上 5E E, U CaE) ,成 立 等 
号 。 

这 样 ，(29) 也 可 以 开拓 至 iER*，jEEB* 也 成 立 ， 从 而 将 定理 
7 中 和 的 B 改 为 E*，{j,} 是 EF* 中 的 无 劣 序列 时 ， 定 理 ?7 仍 然 正确 . 

定理 8 ERIKS, WEKEN. 

证 对 于 距离 空间 ， NRE RE Ph ae E— RH’, AH 
WEF RTE, 

BEEF ETE EIEEE", MEn ARE RTA, Tic 
为 {5.1}， 使 得 EmN COFEE RAS). HFL, AAE 


E, 有 


利用 对 和 角 线 法 则 ， 可 以 选取 { 的 子 列 {Enj EEEE, 
{KK(i,&6)} 都 是 实数 柯 西 基本 别 ， 按 照 定理 8 前 面 的 一 段 话 ， 奈 列 
,在 BE* 中 必 收 谣 于 某 点 5EEB"。 此 序列 紧 性 .证 

定理 9 HP, 几乎 一 切 @E 品 ， 或 者 


x9 €H, MRAZ (32) 
WO TERR | | 
d ~ limer, = £o € dE, 可 时 = oo, (33) 


D REM: RAHA, W, $3, Bw. 
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这 里 五 = f SE > Pi Jah WREE, 


证 Feb, t, EH ERRI. ELL, EJB, P, 
几乎 必然 存在 有 和 穷 极限 
limkK (i, £n) 对 一 切 iEE， 
从 而 存在 极限 
d—limz, =r, EE*, l 
RRA IBRE,, Sir. Gor, FW, 链 将 总 是 在 
Es, 中 运动， 由 于 链 在 每 个 非常 运 状 态 ICE, 中 停留 的 次 数 总 是 有 
R, Amr EE, 所 以 x EE* 一 上 B, =E, 证 完 . 
(EO 能 极 状 态 的 分 布 
KEREI, KRKRAT, BP, LPR. we, 的 分 布 为 


wep, (=P, (2, Er) ree", (34) 
Reh BiB oh EH U CoE) E. 
定理 10 BLYE" LHR wars MBorel yyw, Mi 
Eyu(x;) = | KG, Eu (Z)ncdé), 635) 
Motes l 
Elp) lyre 之 Gi,Du(1-— > Bis }, (36) 
Eya(,)1,;-«> \xa, Eyu(E cde), (37) 
rH 
特别 地 | 
Pite, ET) = (Ka, Dede), reHU WE) (38) 


Pa, =f) = Pie =},8<00) | 
=G, D(1- EPa) JEE (39) 
Pitz ED) = Pile Er, B= 20) 
= |KG,£)ucdé), rcae, (40) 


工 
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BOSP, =h ND Nps), FEB. CD 


证 当 和 名 E (OE) 
Pilze = 8) = ACS), 


RE) =P (2, =&) = DY Yal En 


Piler, =€) = KC, SNE SE (GF),, 
于 是 
EW {Ta OT getEh = | KG,Eu (EN (dé), (42) 


EJ 
Aik, IEE I, 
Pix =j) = Pilz; 3}, B<} 
= S Pita, =F, n= B= Sp?;(1— S Dis ), 
时 一 站 


nog E 


由 此 得 (39)， 测 (39) 得 (36) 和 41)， 并 且 由 (39) 及 (41) 得 
Bucy) Lisem = SEGOE dE), (43) 


H 


青 次 ， 比 较 (13) (15) C22)， 我 们 得 
Pi(z, =F) = KG, jP, (2, =j), IEE, (44) 
于 是 
ET 》= D DP, == DeKaP a, =p 
=E,K(,z,)u(t,), (45) 
ADE, 则 当 z; EHU (EDR, tot B, 2, >t, May (IE), 


IN, REDRA KRADO HERE, To= oo, Mey ws, = 


A,uw(A)=0, RE, Sue $e AAH, ERO AR, 
i (45) 


Ei ry Jl ct pete EN 


a 49 6 


=E, K(i, ©, Cay Yl ep cP ce En) 


= | KG, &)u(E)ucdé>, (46) 


Hui? Bi; 
M (42}(46》 得 (35》 WHU EAE Se PR ee, M 
vin 43-14 XS AE Th Boret pki Bru, ewe. FH GGD FR C87). EZ. 
定理 11 HAE bee Ml 
[ UOM) = Euta = Du Sew) 
E* | ° 


+ lm S raped, C47) | 
ae ad 


i., SAU E* CRER RAA, 

Euz.) = lim Fuir = impt), 
出 此 及 (39) 得 (47)， 

(六 》b- 链 和 过 份 西数 的 马 事 表现 


设 h 为 ?可 积 的 P 过 份 函 数 ， 即 之 Yi<co。 由 于 定理 3:，h 是 
RAR. 32 

| E*= {i hy> oO}, pi, = Puts, i, JOE, (48) 
则 由 hk 的 过 份 性 易 得 | 
Pi; =, ice, jek, } 

fi; =0, ic EB, EE, 
W= (prh, t, JOE DIE HAA AI ed AE E. A Phy — 
2 ee ES REX = {r m8} PRR. HRS TR EH , 
h- ei UPA HRB RAW RR. BG 号 - 链 的 一 切 特 征 


(49) 


HANA win G= EP, MEPL 等 等 
显然 测度 fi =y GOED HFR RNE, E 


pi = ti, i, JCE (50) 


从 而 
Gi, D = gü, Dhi, i, JCE (51) 


nj) = Nh;, JEE (52) 
pp ayo, q= 7G, 
a” GD 可 见 ， 对 于 -人 备 ， 定 理 2.2 中 状态 分 解 定理 取 下 面 


B=E: (Jet). | (53,) 
hee | L7 


其 中 

Ei = Ef E., E! = ENE., ac a, (53,) 
Ek- BERS PIRRE, Bp 

m={t, iem, D PA <ih 


j E E T 


=fi, IEE, D Pih), (535) 


fed 
i ay 
HPCE CE, (534) 
ti, JEE, HAD, 


firs 之 PiP PERE eP; j 


H — 11 


i 
=o Pus Pas, “Pi, a 


_ Fi hy 
— a i. | 


(53) 


其 中 之 FRA HEE, aian- iM, 而 之 表示 对 
ij, AEE, 1<l<n~ DRA, A (52) 得 

Fi = iana i, ik, (54) 
从 而 


751" 


Ah= SM yif = D tid sts = Ahi IEE, (5D) 


peut 
TEPIH FY HBS RA 
KG, = t= Eh, i jem, (56) 


HEZA., WE {KG FDEP, M LK, 
Je. Bb 7 gH keH Sihali 
扯 一 殖 ， 因 而 8&- 链 的 马 亭 列 紧 空 间 己 * 了 可 以 看 作 是 到 的 周子 空间 ， 
RJE EEE" oh iy pt. Whee Se ROP REE E* 中 的 
Ww, Rp 

gE = (gE) EB, 

iz, nagh- MRSA. MARRS zy 的 分 布 
Hin, BARRE THU OB, (eA Mae E, BA AE EK 
MEE, Ep 


ED = Ptr Er), Fe é*, C57) 
则 
MESS- yP, CE*) = > := 2 Yih . (58) 
icr’ jrk’ 
,CE*—E'*)=0, {59 


定理 12 Pou IRE" LHe BAR Borel 函数 ， 则 当 te E" 
时 ， 
Bluczy)= | KG, Eu Emde), (60) 


E}u(aty) Ly co = » Gi, PUR; =- S Pih), 


(61) 
Ejulzp) Lye] KG, EEMB, C62) 
. gf 
see] Bh, ic E'H 
pix, en)= | Kc » EdE» (63) 
r 
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Pilsa =F) =Dilay =), B<) 
eG, 站 (Pa 一 D> Byles jEE,, (64) 
i i 


Pile, ECT) = p(z ET, B=oo) 


=p x Eyu,(d&), PAE, (65) 
P. . 
KD = (hy Dphs), JEE (66) 


MuBE LERES M | 
f u(E)p(dĒ) = Duin (Bs — D pih) 


E 


+ lim DAL (67) 


HE. 应 用 定理 10 和 11 的 结论 于 h- 链 ， FER (56) KEG 
EENT. l 
定理 13 ihera mii aA. Ml 


h; =| KG, epi(dE) (68) 
T 


= BGG, P(r D Pih) + [Kc EC dE) 


| (68,)- 
证 。 在 (60) 中 令 w 三 1 得 (68) HICH Rar, BITE, 
Bik, =0。 由 (49), AKG, 门 =0 GEEH, MEKU, &)=0 Œ 
GEM), EROH, 
f xa, E yu, dE) =| KG, Et dE) =0, 


E La 


于 是 GD J ZEER. 

AIH C66), AC68998(68,), ESE, 

注 。 测度 p 称 泡 n 的 谱 测 度 ， 63 AAE AEn 
表现 。 
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(bh) SR BSF 
IEE, MKC, 站 是 过 份 测度 ， 因而 可 ES if ce M BE Wires pie 
由 (68) 太 (24)， 


Hre; CE*) = > riKet, jy}=1, (63) 


定理 14 WAR TI eee, A 
l Hre = Ajs JEE, U (9E)... C70) 
证。 记 h =-Kc-, PD, CE, W 


(ph); = Sm,K(s, fy= Oe Dao) 
: ng) 


1 
k 一 fr i 二 
cP 3 nO) 


FER (6); Pe. pDl HER 938 (70, 


: = Fila 
= w) hy, Kii, 4.) = 4 
当 j=£, (ce x) HY, KO, €,) Ale) 


mD = 之 Vivi (2 =) 
=> YR Æ). 


其 中 D | 表示 在 BF 上 求 和 。 考 处 到 (54) Rh(E)= K (Er E) = 
AGE), He 


H= > yeh, ERE) 
一 X Yi: (E) A =}, (71) 
H C69 bec. o = Or. 证 完 。 
EMT 令 
B={& €60F, pay.) =: ), (72> 


s 15d +* 


PBA RHET. WME EEB >0, REX RTM, 
一 切 原子 边界 点 组 成 的 集合 B, 称 为 链 的 原子 边界 ，B, = 8 一 8, 称 
为 链 和 的 非 原子 边界 。B= 了 UB, 

He Red, £68, RAW 


ES) = PCy Ea) = 之 PC = Ee) 


= 之 viti(é) = ACE.) >0, 


MET IRA RSE IAS a, B 


是 理 15 WEE B, MKC, HAMAR, A 
Yk, G=1, EEB, | (74) 


EL 记 h =K(.，&)， 因 k=6;,， 放 由 (681) BEF 0， 其 
Hf = h-~ph, Fit 


DID = +S ¥,(Cf),=0, 
Mittf=0, MKO, (OBR. Re (58 BR G1), 4E 
Bry, | 

13 pec. ey) = 之 Kd, Djal, 


从 而 得 (74)。 证 完 ， 


定理 16 BROEW Borel FR. WEVA Mit wath, A 
WOE— BY= 0., 
WE. 因 &EQE 时 ， 由 (58) 及 (31)， 


Hro yy CB*) = 2 vikd, <l, 
因此 


= {E，EEDE，Hat Elh, (75) 
MTEE OE, —A(67), 


«754 = 


Bry. 4 CS) = lim | er" Eege, o (d5) 


T — oo m 
E 


= lim Dert ns [ KG, D- Spake, 8 | 


+ lim lim > Yipr KG, Eye 。 (75,) 


由 此 知 B 是 Borel 集 。 | 
WECGE, MICK =K¢+, E., BevPHPH AE” |b Mee wR, 
m0, mor0, 刚 


E pi) Cine) 一 > yhpi ted pp tats) 


iii f 


= ` Yifu p DEP En) a 


&m>oco, PAGO RNA 
Et spr.) p(t.) 


= Dvirihp | EG, 6 Emde) 
= | > YiKti, EPF Cn pee) us (dd) 
= [BF ip¢x,¥ dE. (76) 
Js 
考虑 到 
Er Pp (TX.) = | vtprcas), 


ai 


在 576) Pen wR 
| ecerwceran(aé) 


= |[ {pecde) perma). 


ef af 


HE RA BRR, A EA 
©1568 


PE) = ore (df). 


对 内 几乎 一 切 &EDE 成 立 ， 特 别 地 ， 取 9 为 
Pal) =e "eG, m=], 2, 3, ""* 
得 
] = | ee (df), mai, 2, m 


HJP- HECER., ALR Smo ogy 
1] = Hr: e (Ê) 
Mt, JLE— HEERE, AEDE OE- B) = 0, E., 
Fo Ek-#HŁES FARA, W 
B= BNE", 
证 AWT(75), 
P= {£: EE GE’, Herte ey CE lha 
MoE = (0E) N E, ECAR, FEC75 O nA" aE 


ete. (6) = lim 之 en atl KG, E} 


j EER 
— > p: K's, é) | 
sent . 


+limlim S vipi Kg, Herinn, 
A 


Miwon thor o jek 


HERB] (49)—-(52) A GO), LAAAKATS DAY, Bit 
Mere. CE) = Hak. 2 C8), 由 此 可 得 证 下 = BO E*, IE, 

由 于 定理 16， 定 理 $ 可 如 下 加 强 . 
定理 17 设 Xr = {z,，n 必 Bj} 是 1- 链 ， 则 对 p; 几 乎 一 切 2 E29， 


或 者 | 
| 2, CH, tit p< ce (77) 
RARER | 
d- lims, = £a EB, WRAS co。 (78) 
《60)C62) 可 加 强 为 


-+ P57» 


Elate) =] KG, Eemi), (79) 


Fa tl ff 


Bury )1p-— = EG, Dumi. (209 
‘3 l 
特别 地 
Enz = KG, Sud)ncds), (81) 
Bute) li-a = | KG, Du Eede, (82) 


CG) 马 事 表现 的 唯一 性 
定理 18 SAYER OF MRT MB 
m=| K | EAE) o C83) 


Hopi Borel MEU B 上 的 全 有 有限 测度 ， 央 而 和 = 反之 , 任 给 EE。 
UBL 的 全 有 限 测度 h，(33》 确 定 Y 可 积 过 份 商 数 。 此 函数 调 各 当 
HiX 44(E,) = 0 

证 。 在 (79) 中 令 w = 了 1 得 有 表现 (83)， 其 中 入 = 起 EUB 
EWE, MEEA RIER GOH. ， ° 

现 设 # 有 表现 (83}， 往 证 和 =p。 对 EB* 寺 的 连续 函数 4#， 分 别 
FARRE, F67), WRGD, RII 

| (Ey Ls de) =| f uBRe oE) AD, 


E, Us E* 


Haron = Of (SEE, UB), nig | 
| | ‘WE CE) = | U(E Cd), 


Aum eS ee TE UBL, Uma, MERIA S= h, 

AKO, 5 Bit, H (81) 成 立 ， 因 此 (83) 确定 ?可 
mit eR. WEL, KO, & (ECB) WA, WIE) = 
0， 则 (83) 中 的 万 是 调和 的 ， 反 之 ， 设 (83) PMA A, H 
(66》 uJ) =O —-WICE,, HACE) = pE = 和 6。 证 党 。 
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CAR Tt BR 

辐 忆 极 小 过 份 函数 的 定义 2。 我 们 有 : 

定理 19 Y? 可 积极 小 过 侨 酒 数 的 一 般 形 寂 为 CK(s,E), EE 
Eu UB, CEHA. 

和 证 (68), Mn, tea, WECE, UBHK(-,&) 
=h th,, MER A. IA iA e. Meo ROCE 二 0 。 
故 

Ba, (E* —E) + pr, (E*-€) = (E 一 E) =0, Wii 

u, (E* E) =0(e =1,2), 


Hh HEROES), 
nei) = KG, m, (d) 


一 到 全 ?县 (&) = CK (i,&), 
其 中 6.= by (EDR AR. EKO, E (EC Ee U3) 为 极 小 过 份 函 数 ， 


RK Woy veya AB, FB E.G 
设 j 关 0。 由 (58) REM, ME UB)>O, MRE SCE, UBR 


在 & 的 任何 邻 域 中 有 正 测度 。 令 U, (6. dE D<), 


hy = È KC odds, 网 和 


hh = K(+ ,EY (do) 


(EE, AY -T a 


者 是 过 份 画 数 。 由 k 的 极 小 性 ，h,= CACC, 为 常数 )， 从 而 
Lyk) = CEFR, X PP Re BO YE — PES 


Hat) = RD NP), 
考虑 到 (58)， 

CD) =E) = Dyha CG), 

ME) = Dyk). 


= 159 + 


这 样 
hy = RO. JRE wsdl 
全 n> cc 得 有 = CKU,E), hC uE, GES. 
M270 BARBS 
B= {E ECE, K(-,£) ER NAAR M, 


ZyKG,E=1. | (84) 


TE ” 记 右 方 的 集合 为 CC。 由 定理 15 和 19，BcC. 
WECC, Mhk O, E Aran, WEWE A. Sh 有 
EM 
hy = | Kci,008, (dé) 


由 唯一 性 定理 18，hs = ， 即 EEB，CCB。 证 完 ， 

(+> 禾 慑 域 和 终极 随机 变量 

EARRAK Go, fas Tes * «(RE E, So 1, 25 TIBE: 
不 变 的 ， REEN CE, k=0, 1, 2, 有 ji 
= fisz; Iss +.. 

定义 8 eure. Ha BO i A ER EE PLE MSE 
术 变 函数 /使 得 

PDD) = fle, (@), Tag, (@) yor}, OCD, 
对 m=0 有 从 而 对 一 切 nSo Miz, SALAS By = 
~2., ER HO, RRAACL.AARE, MRE 14 是 终 
a RABE ULE ee Wh SSR HS ERRE RERA F ao, RAR 
极 域 。 

BA, ALES, WP, {((A,~A,)+(A,-Ai)} =0, Mic 
A,=A,, WED, 2, HHP, HP, (P, +9, =0, Mic 
D, =@,, 

定理 21 非 输 终极 集 人 和 上 儿 乎 闭 售 4( 除 瞬时 集 不 计 外 ) 在 下 
列 条 性 下 一 一 对 应 ， 


+ 了 看 人 


Am &CA), (85) 
4 可 以 取 为 上 = {1 PKA) >e}, (ceci, 
证 OAChungli, 1817, 21, 
定理 22 非 估 有 界 了 调和 函数 4 与 非 负 有 界 终极 随机 变量 下 在 
下 列 条 件 下 一 一 对 应 ， 
Wi 三 Bi， 中 = limu(2,) (86) 


证 OChungl1, 1§17, #885), 

HRS 非 零 终极 集 4E 二- 称 为 原子 的 ， 如 果 4 不 能 分 成 两 
个 非 零 终极 集 的 并 ， 非 党 终极 集 4E3B- 称 为 完全 非 原 子 的 ， 如 果 
对 性 总 4 和 机， AEZ., WA BABAT A. 

定理 23 4- 有 下 列 分 解 


8.= 人， HUJA). (87) 
其 中 A HESIERTRRE, EUR. v HER, aM 
ay PFC, HoE, Adac) 为 原子 终 级 集 。 分 解 是 
RE — A. 
7 利用 定理 2. 3 和 将 要 证 明 的 定理 5 6 而 获 证 ， 
{十 一 ) 马 事 流入 边界 
前 责 论 及 的 蕊 襄 边 界 实际 上 是 马 训 流出 边界 ， 即 描述 过 程 是 
如 栖 从 有 限 状态 路 向 无 旁 的 。 至 于 撒 述 过 程 如 何 从 无 穷 来 到 有 穷 
AS, WHEBAH AM HK. 
BO REP = (Pij,i,iEE) 的 状态 分 解 为 (2.15), EBER 
BRBR, ic 
Es = {lt iE€E,, FI EE- Bii}, 
E s= E-E, Pi =(P;;,t,jC By) 
#11, AAR] 指出 ，P 的 任 辣 有 有 限 过 份 测度 a IED 在 
Esn bbw, Be; =007CH,.), MAREE, LHENDE 
测度 ， 我 们 指定 一 个 这 祥 的 P 过 省 测度 (a;，iEE)， 则 测度 (Vy， 
FE BE) 是 的 有 限 过 份 (有 有限 调和 ) 测度 的 充 要 条 件 是 了, =0 GE 
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LICE, EP ARE ARMDAN. RE 


PaE. i,f€E,), Pys GEA. 
vy 
ARP 的 标准 测度 了 ， ， 根 据 ? 和 P S 我 们 可 以 确定 P AY) Ey eS 1 
ab, ERE A B ， 原 子 边 界 B 和 非 原子 边界 B, 分 别称 
dE, ,B,B, Rl B ,为 P 的 马 亭 流入 边界 ， 本 质 马 亭 流入 边界 ， 原子 流 
入 边界 ， 非 原子 流入 边界 ， 上 述 诸 边 界 当 然 与 a 及 Y 有关。 因此， 
对 于 流入 边界 及 过 份 测度 的 研究 ， 可 以 借助 于 对 流出 边界 及 过 从 
函数 的 研究 而 得 到 我 们 不 详 述 了 ，。 


§ 4， 中饭 位 势 的 概率 表现 


ENL 称 非 负 ( 包 括 + oo) aR EP 的 位 势 ， 如 果 存 在 非 
Tih Biv thie = Ge = SP , Rp 


a= ao 
= Bec, j)u;, ICE a 


SEAS fie eee Be RNY, ae = et + u! sf R= Cae 
(a=1, 2, ), CHRR. 

Mu = Gv, MPu=PGu=(G—Ivuru-v, i, Sno 
Sivi = Ms — Pu) hu RE PETE 

定义 ?2 PAP HS. 如 果 & = Go， 并 且 w= 0 GEE 
-~ 互 )，B 为 中 断 状 态 集 。 

定理 1 w 是 P 的 中 断 位 势 的 充 要 条 忻 是 ， 存 硒 非 负 函 数 j, (a 
€H) 

t = Bil funs p<co}= 并 ja t E, (2) 


å t if 


其 中 7 
ui =Pi{x,=a}=GU,ad, oCH, (3) 


a 762 = 


是 极 小 位 势 ， 而 dd 是 状态 0 的 中 断 量 ， 

如 果 tt 有 限 ， 则 4 与 1 的 对 应 是 一 一 的 ， 并 县 1.(20EH) 也 是 有 
有限 的 . 

证 充分 性 。 由 (3.77)，- 

| u= E {fens BO} TEAS, Ao, (8) CH} 


一 D> Elfs B=n, zin) €H} 


TL= CE 


= > $ Pida = SGti,ads,. (4) 
m- agpi ' 


Bice (2) URE TRS. PA, DORE. 
EEn BARN, Bet=u,+u,, m= Gu (b=1,2) 是 位 

$, 

故 


Lo 3 
dD) = (ut ~ pur); = >) (ut, — pay), 
由 一 于 


=v (f) +v (P), 
MT Adb, 2, 0 HBO, F= o=], 
2). 7 l 


WEEE Bu = Gude PE RA = 了 (a€H), 由 (4), 4 


(2) 成 立 . a 
对 应 的 一 一 性 由 定义 2 前 面 的 一 段 话 得 出 ,证 毕 ， 


§ 5， 训 留 解 ， 终 极 集 ， 几 平 闭 集 和 边界 


定理 1 《〈 非 负 ) 有 界 调和 函数 pn 与 B 上 的 非 代 有 界 波 雷 尔 阴 数 


m = | KODEORD, 0D 
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ny = f(2.), Efi) = hi, ' (2) 


其 中 测度 4 是 纺 极 状态 的 分 布 ， 由 (3.34) 确 定 

证 kE., A DAEAR., EZ, Ekg 
界 调和 函数 ,不 妨 设 其 界 为 1。 则 h 和 9= 1-h 均 过 份 , 按 定理 3.18， 
M(E) =0, E | 


1= | KG, ued) = { K (1,2) (a + Hp) (dE), 
Ea UA Ep us 


PL = Mat By eee TANLA EER, CE) = CE) HCE), 
(3.83) RH (1), 

MEC) Ahs B(S (zo)， 加 .}。 因 而 (2) 式 由 定理 3.22 得 出 ， 
证 毕 。 | 

定理 2 Wao HBA {e(co) CT} Borik rch) 所 产 
AEA. E ABorelkR, WF. = Brio, 

证 AVA SPR AAS oe) FY BG POY DS aS Cx.) 的 形式 ， 
Bp EBL MSE AAR. Bo (2) Me =f (cB. 
BY WA. EMF s CH, 

RPATFAAARH 鹤 - 可 油画 数 。 依 定理 3.22， 玉 = EDHE 
FAME P= 了 npse%。 由 定理 1， 存 在 B 上 的 有 界 Borel 可 调 函 数 


TEDRE, AMP Hf), PEPP eN, Wei 
Frs HEHE, 

定理 3 NEM ILE RRA, SERB REICE, $ 

PLAYS {r Er) | (3) 

eae RIS, TEER. 

证 因 2(4)E. 多 。.， 利 用 定理 2 便 得 证 本 定理 . 

Mi KIER RY Ce) Hie, MAME 
VEAC): usu, ven 一 tt 有 v= 这 里 

w; = PQ.) = PAG (EY Ew), (4) 
定理 4 GU SIL ARAC RRA) PARE 


ELLES 


{=*F i 4. ëO 


下 一 一 对 bp 
u= Pi AY} (5). 
证 RUA. AiieiaM, (RTE HE3.22, FEER 
R PADLE ED, 0D ED, BR 
yomini®@, 1- DP)lec1;} 
FESR MPLA, dhe = BE iC), WHu<e, vc u-u, T 
是 ?= 0， 从 而 ?0。 由 此 得 中 -loi ACP =1) 是 非 零 的 终 
Sh, HR REHBS.21, GULP EARP = DSF), OR, 
H; = EP = Bite) = Bilas = Pil SCA), 
今 设 tt 由 (5) 确 定 ，。 EVEA OY, Au, Eu u, ie 3.21 
和 3.,22， 


|] yer, = HIME penis dece—4y= lim| u xing yen) |. 
Tore: A — > 


BARRED, 0ps Hi 


i= ED, P= limo, |. 


Alvusminctu, uw ~ tt), We MISC leas Lee) =O 
Gv = E; P= 0, LE, 

EES WA He. ERREA, JLE REA Cit E 
LEM), Rese FRE RET TCC, EEDA, PEP 
列 条 件 下 一 一 对 应 ， 

Wi= Pi SCAD), As (A= (2, EF}, (6) 

证 综合 定理 3 和 4 以 太 定 理 3.21 即 可 ， 

定居 2 PULA, 如果 4 作 为 调和 六 数 是 极 小 的 ， 
E A RE SC SIERRA, DRE RB au, off KER 
小 的 ， 

BR, WARP PSE FAM, Mui =P 
(22(4 是 最 大 的 完全 非 极 小 逗留 解 . 

作为 定理 5 的 特 款 ， 我 们 有 下 面 的 定理 6. 

定理 6 meJ RhE Mfu (<u), SES ARTA 
(TAa BACS.87)), FOSSETT ILE ARACCA,, FATA 
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RZAD, eS BRACE, ,并 不 计 k 零 集 之 差别 ) 按 
(6) 一 一 对 应 ， 
RUNES ie, FRR A, FLPMA ORT oy E 
2223) A PUR ES BRE IK R—— I, 
At CAD n EE, PZLA . (7) 
定理 7 ZARARA, ENARRARE, EnA 
Fe RRR ELEBLATRH ER LMA BED 接 下 列 
关系 一 一 对 应 ， 
i = ED, P Mins fir ob, CB) 


证 综合 定理 3,22 和 定理 1 而 得 ， 
人 6， 典范 过 程 


KER ABT. FRR “oO” (oo EE) RE BP FRE 而 得 
E = 五 :J{fco}。 设 co 是 定义 在 完备 概率 空间 (2 并,P) 上 的 非 负 ( 包 
46 50 37 EIEH, PRX (@) = {7 0) t <o) EMRAH 
氏 过 程 ,或 简称 过 程 , 如 果 对 任意 @E8 和 fi<ctey 有 zfao)E E, 但 
| P{x{t) =co} =0, t0, (1) 
Wee Mise, ot Lt, ery by To oy tay CER 
EP{e(t, =i, Ixa<i}>o, RA 

Plt eet) Shar (PUD Hb, Least} 


ws a ——— 


= Pef faa = iyi Dih (2) 
WA EAR AK, RBG, 一 十 有 关 。 称 | 
Pi(t)=Pila(stt)=jiz(s) =i} (3) 


”为 过 程 的 转移 概率 ,其 转移 概率 矩阵 PC) = {pa(1)}) 必 满足 (1.,2. 
A, BD, ROEE 还 灌 足 (1.2.0C}。 按照 第 一 章 §$1 的 记号 ， 即 
PLf)E .FF。 如 果 丙 个 过 程 了 和 XX 有 家 同 的 转移 概率 知 阵 P(t) 我 们 
说 下 与 是 同一 过 程 ， 

1) Mar (o=761,0), 2H Mo. 

e :于 在世 > 


s oe t ® FF 


反之 ， 圣 于 每 个 Pt E 7， 存在 过 程 刁 = (eh), to}, W 
POD A ee BR, UREA, RATA DRA SESS, 
RBA, MB FES, MHT, 


lima(s,@) =2(#,@) CE RW-Wi<o(@, - (4) 
ede 


PIX PE FS, MX, (4) 对 几乎 一 切 @E 2 
成 立 ， 对 例外 的 0，X(t@) 其 至 可 以 无 定义 。 此 时 我 们 可 以 对 例外 
Meo, Boke eet sie SOA 
rt, @)=i1,CE, t<o(@)=0, (5) 
BRUHA, BR, 2TH HM. RR 
第 一 章 1 的 记号 ， 对 应 于 PE.7F RX C & 组 成 的 类 记 为 
Pou SHEP) CF ,CO) A REREX C &, 组 成 的 类 记 为 PQ), 
PREO HAA Oa, 
“4 Pio = 00}= 1 GEE, LEX HH Ro 4 ER 
(1 .2 .五 ) 碟 立时 ， 天 是 不 中 断 的 
MH ME REX = (x( 8), o), 可 以 任 取信 EB ， 然后 令 
w(t) = {8s ARES (6) 
和 六， 如 果 1 宇 0., | 
WX = {2 (4), too} Bases ie BA, Se RARE (1) = 
(PsP 34, FE BU CA} HCL. 2.3) BE, 
XSL, Fo 为 由 集合 {rosies IEE) 所 产生 的 
Borelik, ic F ho = (let 。 
定理 1 Fles], 
HEHH W Cheng[1, H $8, #1 
Pe AE AH LAE EBAN EHS SRRA RA RB MA BS 


o, HME Ri So, , 
(BSEC E Ft, (7) 


或 等 价 地 


(BLECE Fia | (8) 


a J67 


MW 8, SF CATER A CEs =(BCORAN BS € ¥} 
(SPO HARR., FIABE. OF CAM rB +t) =i} 
EE, t2>eOHMRARMERL, LARA RM, PAA. 

WMXAVZEA, ARLEN FLAS OPRAH BA TO, , 使 保持 
F. X. ER, HH 


O{ett s=ih={e(P+!) =H}, (9) 
ABQ AY ELST 2 Fy PSE Oe, Re 
O,a(t)=x(8+t), (E20) | (19) 


详 见 了 armE1， 第 121 一 144 责 ]， 
定理 2 XE 必 具 有 强 马 氏 性 ， 即 它 具 有 下 列 性 质 ， 对 任何 马 
BS, EPRS, | 
(DD PME FS, ACF, W | 
P{OM|A, (8) =i} =P{M}, ICE, (11) 


(ii) P{a(B+t)=co}=0, #>09, (12) 
{X(+ E), Lto- BÆ, RF, POJEJ REE, 
其 转移 概率 为 CPi; (2), 


GDA A = {re(B) 400}, 0=0-B, x(t)=x(B+ t). 
M X cos {r G, ，t<07(0@)}，(@E A’) 是 定义 在 概率 空 
MCAS, ACH, POA’) ERO, X 的 状态 空间 B' 会 
TE, HAERERE XKR BARIERE xE EAE. 

RX 为 B 后 过 程 ， 

证 明 见 王 榜 坤 [2， §3.3]3%Chung 1, H $9]， 

定理 3 ” 设 XE 如， 有 是 天 的 马 时 ，e 是 B 后 进程 和 的 马 时 ， 则 
B+ afi X iy So. ~ 

HER Chengl1, H $15, 3381), 


57. REMOTE 


PE On RX C A DAMA ROU EPN E F OL 
A. FTP Ort BA EH, RE PP A A PG E 
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F.(O) WHEAT Sy RH g 
对 于 Q 过 程 XE 人 (8)， 右 下 于 连续 性 (6.4) 成 为 在 五 由 的 右 
连续 性 ， 


lima<s, @)=a(t, 0) EB, 对 一 切 +<a(o) 。 (1) 


MROWHX & (OE wa: 
limz(s, 从) = XT @ CE, we—Wi<o(e@), (2) 


BXADBTEH. DPPRBARHARAAL.. HORE, DWE 
EX A RY Bid 2a), 

定义 1 BXC#, Go, Pe HOAX) H-TiR i, M 
果 

wtf, @)=i, 对 一 切 了 三 [ b), 

HEERR[e, OHATRHMRML, dE, rt, ose, Biz 
Adit, i 区 间 称 为 常 值 区 间 ， 

定理 1 设 XE 名 ，4 达 0。 则 对 几乎 一 切 @ 如 ,和 XC@) 在 任意 
Pt OX fa] RAA RAR M. 

证 明了 砚 玉 梓 坤 2， 8 3.1， 定 理 2J 或 Chung[1, $5, 定理 7]， 

XE 2.0). BR 


= [COS ESS, rC Sri), (3) 

oo， 如果 上 面 的 集合 为 空 集 。 

为 天 的 第 一 个 间 晰 点， 

定理 2 BX 2,19), W 

Piir >tjs emnt, (4) 

a> ORF, a 
Pifz(ri) =f} = JEE, | (5) 
Pilit) = c0} = p {t,<o}- > Wise (6) 


Beal = (p) 出 (1.93.7) 确 定 ， 
BEAR M EHL, $2.2 AGT, 
EEI EXCH, Ogio, PAXE BIH, p{s(8) æi} = 
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0，% 为 8 后 的 第 一 个 间断 点 ， 今 p= ge 一。 则 对 八 E 关 ME 
| P{A, .p>t, M}=P{A}e HPM] Q} | 
HB, F RIFLE FQ, 条 件 独 立 ， 更 特别 地 ，z(r:)》 与 fi 关于 
测度 Pi 条 件 独立 、 
证 明 见 王 梓 坤 [2，§8.3 定 理 1 系 2] 或 Chung[1，I§ 15, 定 理 
Ala l 
te XE #0), FF 
g [itll ncia asi, 
| oc， 如 果 上 而 的 集合 为 空 集 . | 
4 S—+A A Dia eP) 1, Ri, 
如 果 i 常 返 ， 并 且 Ea 
| o masba, | o 
称 i 为 遍历 的 。 如 果 一 IE Pit AX aa 。 
定理 4 
O 庙 返 的 充 要 条 件 是 对 几乎 一 切 oE (2(0) = i}, Xow 
ae SIR al, Bes oth, 


| pepdi = oo 
(ii) iR, MIP {g=o}=1, ADF 


(7) 


limp; (4) =m; >0, | (9) 
MRH, CHEIRT ER, Il 

lim palh = — L, iG’, o (10 

bene qiii 


ERUNLEREIRC2, § 4.2, RIRChung, $10 ZH 
4 及 其 系 1， 工 8$ 12569) Al 


83. 概率 的 最 小 过 程 


EXI EXC Z, PIE, clo ]-WX Co ay BRA, 如 时 
t=o(o) CoB MEIC ERe>ofiiztu, ©) =i- eE, ft), wR 


e77f-« 


Hicc@ ARAM, FOERe>omyucc(i-e, DET (ce, 
w) =i, MUCH, +8) 有 LX(R G=F, RECUO, ow] AXO) 
Ai CA, Mis ol@)<coo, RA i<c(@) HAERE, Xo) 
在 Ci-8, +O PARAS PRI. 约定 ， 1=0 是 跳跃 点 和 
ERA. PRAS 0 ARAA O TP KI, 

每 个 2 过 程 XE &,(O) MBB KR, 


{< aoia), lim x(s, @) = oo}, 
oO), WR EMR A 2 R. 
ABYSS — PTH ANT Ah ee DEER A. BORST, zi 是 跳跃 点。 如 
FBT (<0) AE BEER, KE, 2, Silt ERT KBR 


EEL XEF, Q), ado, W 


Piir, =r} = Eh | (2) 


其 中 9 为 吕 的 非 保 守 景 ， 由 《1.2.6) 确定 。 
证 。 由 《7 .6)， 
Pii{t,=th}=Pi{e(t,) =c}+P;{t, =0} 


(1) 


定理 2 设 XE 2.10), BEA MIEAM OLS REIA. 
(i>) AR 


P(A =9,, A}=P;{ġ=r, +0, 8:1, (3) 
则 u,=£,& A} WEE 

2,4: jh; = —P{/\}, . (4) l 
nG) = E; {ei A} GSO WETA 

At 一 >, Fist, = 0. (5). 

Gi) 如 果 
Pi{Tti=7T, A}=3P{r,=7), a (6) 
Pit ict, Bi AJE PTET, A}, (7) 


让 


W u=P {^} 满足 方程 
PCE j= di, (3) 


WE a =ON-F MN. Hea, 
fH REL OYE, E7 2T Hace, Hy Ph ee, 
E E, AJ SE {t +6, Š, a. AN} 
= DME {t,+0,,6 0,,A|a(t,) =F} 


= CE {t,,8,, A] a(t.) = 7} + E, 6, 8,, A JEC) 
= f}) 
= DI EAT PAT +E AE AD 


= Pi At DGE, A}. 


WIE C4), EK, 
E;{e""', 大 = > MaRe tne, e- 68, A leir) =F} 


= D HE {e n Je, = Bi{0, e, 0, AlE) =} 


= $ HBe tn EHe, A} 
? 


= di S 。 -4 
À +q SHBi{e 7 AJo» 


ik C5). Be, 
PAA}=P{A, tT=t }+PH6,, A, tT, <1} 
= Pi{t=t,} + 2 HPA}. 
注意 (2), HE (8), DEB, 
定理 3 XEF) AB RA AARBANWNKRESAE: X 
JLA—-Wee2, Xo) AP i eR, BRR. ARE 前 
方程 组 的 充 要 条 件 是 ， 对 任意 指定 >0， 对 几乎 一 项 2 E G<), 
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K EC, PAREA A. m BE BERK AR. 

TEAR M EPEC, $2.3 定理 1 和 21. 

定理 4 RIXE, TAB—-PRER, WY = (echt 
PEPO , RRBMARE RBS OPM BR DRS C= 
{ Ct)}, 

WERE EPET, § 2.3, E5], 

定义 2 X= fet), Ecol E g OARE, RPT 
so}=1, HpTA ARRA. 

HAC 2.(0), 1 JE —- PBR. Er, MET =, E 
时 T= co, AT, scof(n>]), Mat, <o, Waar, = too, 
Hite. Cn > 278 Base, RAGAT. IERT ERROR, Bit, 后 有 有 
第 一 个 间断 点 5 让 fr， 如 果 T; = co, hit soo, FPS T, = O(n > 
2), WR ,<oo, MAAT To, WAN TODD ARE, 或 
Brot, INT SRN, AT AP ast, AN 
此 继续 ， 

jot, = 0, = r,s 


QF = U (tn= 1 00), 
| (9) 
总 .= N (TAT) + U (et =co) 
此 -一 q= j 
HOD, OE lda, 
=| mn (10) 
sup{n, 20, TAT} ioc Op. 


T, = limr, (11> 


MEEA: <T, FQ. AT, HT. 

ye, = ce 时 ,约定 z(z)= x(t), HA = maim, tao), 
RE, Bes PR)r,<t, Bh, ce AEM, 

由 强 马 氏 性 及 和 证 理 7.2 得 

定理 5 Xr= {X(t,) ,nn 所 BP} 或 记 作 Xr= (XC1,), Xt JEG 
gt, ERIE ee BAAN =<, 5h (1.9.7) BRE. 

FU REX AH EXCD, (<TR ARE, PERE HE 
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ORT AIEEE, 
§ 9， 预 解 过 程 和 导出 过 程 


BX = {zf)，+<6}E€ 名 ，P 为 与 XX 独立 的 随机 变量 ， 其 分 布 
是 参数 为 1 的 指数 分 布 ， 


Ploa>t}=e', t20. (1) 
HASO, 4 
pi'=2, ot=min(o, p°), 0) 
ei(ty=2(8), t<ot, 
定理 1 X'={x'(t), <0) Er, 其 转移 概率 为 
Dis(t)=e Pu), (3) 


其 中 Bi 是 于 的 转移 概率 ， 


证 AX? 的 轨道 是 X 的 轨道 的 前 面 一 部 分 。 我 们 只 需 证 X! 的 
FF CK SS BCE BPAY, 
BOS LEL Enas ty dassin ECE, AXHA US 
Fe HE ano XNE, | 
P{x i =i, 1<e<n4+1} 
= P{e(t= iy, LLa, th. ce} 
: = P(e = 41} T] Pines Ca- E) TERET: 


=t 


= Plexi =i, }pli,<e'} [I Piiira Clery fa) 


a=] 


= P{a' (11) =%,) IL», 


RX Ay ACA) FA aah 4 
E2 X= {(2(t), CHABHONE, RAR. 
WU BR EX 是 最 小 @ 过 程 ， 其 中 
di; =4);(i42)), Gq; 一 和 十 全 (4) 


Èa 一 ty}. 
+1 


iai, 


a 174 。 


fe AFA) 1.9. Wa 
证 ABH EHO MT, HAM. RRL, Bry 
下 的 第 一 个 间断 点 ， 则 ft1 smintr,, P), W 
espt- qit) = Piti >t} = Piit >t, Pp >t} | 
= Piit HPIp >t} se wet = expl gt, 
Edi Atg. Hee, Wisi, 


A 
Eii = P;{z*(r])=}}=Pi{z(t =}, tior} 


=P {e(t ) =j} PT <p) = 2h 
玻 91; = ， 证 毕 。 
定理 3 HEX = (208), PCT ROW, AA EAE HY 
Re, P(A) >O, SAR EAL AEX (ao) = {r0 oO, P< 
tT(@)} (@C A) 概率 空间 CA, AF, PAD 上 的 最 小 8 过 
程 ， 其 状态 空间 为 | | 


a Hiss 


E4= {i'P\(A)>0}, : (5) 
转移 概率 为 
Fi pA) 
PF {t) PAyY * t69 
Q 窍 阵 Q = (q3) G, JEE RF, H 
sa Aa (A) 
qi; = PCA) ža (79) 


证 HAE, HEBO, E G<T) 上 上 有 4- BA, AH 
CAS. Kishk, BARR, FHA Reh 
la =8(t(t,), Fae. ), CO 对 一 茹 #。 (8) 
于 是 由 了 xRkuaf1， 第 122 页 1， 
Le a= BCA COT), OFT dy D. 


= BELCA), TAT’ ee (9) 
在 GLO E, SEPET SiT Mot. =T.4;, TE 
HERD), 


©1736 


le 4 wR Tas pds UT age ds Tt) = La 


HÆLD EAA = 0A, 
Poat ci rein ty te, cy bwi CE", 
He XB FF RE AHE 
Pl2tct,, =i t= 
= PÒC tn) = ina ]A, Eta) Sia Eann} 


_ P{a(t,) =i, 1&Sasn+], A} 


Ple(t,=ia, [<a<n,A} 


_ P{xG ah, xasntt, Oni) 
Pielii =i, 1=a=n,8,,A } 


i 


=P; i Cari — Eala 


LJ #-ł 


FIP AB UO 保守 。 而 这 可 以 从 
P(A) =P,(8,, A) = > I;,P,(A) 
得 出 ， 证 毕 。 
系 EXSER OWE, PCO.) >0, MXE., OF, 
POJO. DERRE O “保守 过 程 。 
EXI 称 过 程 X 为 最 小 9 过 程 区 在 终极 集 和 上 的 导出 过 程 。 


§ 10. II(4) 的 位 势 的 概率 表现 


HEX ={2(t), tar) BPO, AHORA TRIS, 4 为 
Q 的 非 保 守 基 , TOA) AX ATARAX BOR ARE. TR Mf: 


=f (i), 
定理 1 OW FRNA), UA) HEE-H EW SAME Tee A he 
EPPA AER 
wi A) =E fe! fira), Brya L Adf] (1) 


Hera f(a)0 (aH), 


1/6 + 


证 充分 性 .由 (1)， 


W= SE fe safle, 4), t= Tt} = ST, 


E d. qi 
Ti= 五 fear E 一 = f, a ~ 
其 中 ife fr o), T,=Th =f; aq, 0° E? 


“aaa difi. 
T= Ele afta, 0), T,=7} 
= 2 Morga Tr i= D yT, 
T" =h Ti = e = I + df, 


W(A) = DATHA +g) df = oars, 


HUA) RADY, = pals -的 位 势 ， 而 v 在 E~H 上 为 0， 

BEH, p= 1%. coe, 由 完 分 性 的 证 明知 t(X，》 
有 表现 G), IEE, 

定理 2 设 G(X)= DASPAN), 


q= f) 


ARES g. Il 
CHA ul, s Ey{e~**su(e, )}, (2) 


[GO = SE {etue )). (3) 
证 仿 定 理 1 证 《2)， 从 而 得 (3)。 
OTE CAH Ei{e tn, a(r,) =F}, 


Sil. ARŞ SEME 


EUR AEA. BARKE GUT) a 
(RMI), WAAR GRA) Meese OR), 记 
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ALFORD yt K) Cae (KD) 。 

设 uE, W WOjucHusu, MO an ed, 
i WA puu, Hue wt, 如 果 uE, 则 
UAE MICK), 


ENI Buc .ie*, ARERR) = lim (Aye E21 为 4 的 、 


ER, 
定理 1 EP BHLR UAC MIBER, 
AAJU = HCA), (1) 
证 显然 
A l * “4 
SE) = WOA + gH +E, (2) 
a- ğü «-- 0 


BMS OA) = SAKAM, BODO 成 为 


PBT TAA + = OCA aT +1 

AG’ AY +O AGH OCA GI +1, (3) 
Aq Feu IEE Bu = tw 得 

AO (A) + OM (AGU = OA) GY + 4, 

Ab") (Ayu + (CR CAL + O qlin =u, 

AS’ AU +H Au =a, gy 

Anci), iE, 

BUCA Dae) AD BS, ROAR. UT A) Au ca) 
=#(A), Huho Tata), Hh CE UA), Fp A a =u, 
Hu a an pa Be, (AA A RR 

定义 2 eNO M R Ae, AR R eu = limu A) 
AURREK, 

定理 2 KLANCA WRR ERRA N 


13 4g = ORs 约定 这 = oo ATOU =u A = 0 E =, 
; ; 


W= UCR HADHA), €5) 
其 中 T= limpa) = Sl, 


证 PTA UA HUA 
UCA) + AG HN) = Hu), 
FERN" FEN Oa 1 求 和 得 


a-i 
Uh) AS Tq (Nh) =u), 


t- D 
4>q—~0of8h(5). Tey. 
HE 由 (5) APL, AHHAR GOOS RRR Ge 
1.10.2 相 容 。 但 定义 2 中 可 以 是 指定 的 . 
定理 3 BUONE], UOA) RRR RU Ce, C1) eae 
证 CAD 成 立 。 ÆG HARS uA) + EN? 得 
AG (Nya + OCA) Gin = OA GH +n, 


入 加) 下 二 SPA A+) 7 GHA) 二 FE 了] 
J Q 


n—i 


= 之 CALA + a7 ‘qu CX) ATUA) ] + tts 


KOM (Ayu + PI (CUCA) + APU) =H, 
注意 Megi, 如 | 
AGT (Ajte +A) FA APUCAD = H, (6) 
Ai Pu Cut |, | 
TI") OADE << IATH CA) = Ca — thy] 
=u- uliu- us À, 
EO penna), E, 
EO HuAc.#i, HERRE. W 
pO = Tu), (7) 
证 从 定理 2 和 3 得 出 ， 
Ay dL = (Uh) Ca UA) RUE phe Ca} (8) 


Ma {UC (ue AWA) C MTR ERS. (9) 

定理 4 ETN SSA, BERRA Ree S 
WA, SEA ARERR RAIA Re Sy Tt RR, 

证 显然 ， 标 准 映 象 将 .#81i 喘 象 在 .H+ 上 。 由 定理 3， 标准 哎 
象 是 一 对 一 的 。 今 设 u(X) CMI MEER UC a, TURA Be 
RWA), WERIN, vA) = uta), Buca) uA R. 

定理 5 ”在 标准 映 象 或 \ 映 象 下 ,五 以 ) 极 小 的 4(%) Ewi 与 
正极 小 的 4 E .下 一 一 对 应 。 

证 ” 依 极 小 性 定义 ， 利 用 定理 4 可 得 。 


&12， 最 小 Q 过 程 的 边界 


X= {at), tT AEDO., Xr={e07,), nab AE 
BARE, BORAT, ER 8 3, REX, Fe ay E F 
THB FARE, RBRB, 原子 边界 B, 积 非 原子 边 浴 8B;， 
有 以及 终极 波 雷 尔 域 多 .等 概念 。 RITE 8 BO WHIAS. 
得 现在 的 情形 ，(2.17) 中 的 8 和 应 按 (8.9)C8.10) 理解 ; 五 应 
为 上 @ 的 非 保守 状态 集 ; GIDRA 

YIT 一 人 0) = limz(r,) CHUB, (1) 


pe eae, Eek, er OCH, 在 上，X(T 一 9) 万 加 ; 而 
《3.34) 的 测度 4 成 为 

ucTY=P,{rT-0) Er}, TCOHLB. <2) 

BAR, MECB IN, KODEA, BEKO, &) MAMBH 

Kits, 点 )。 册 和 论 理 11.1 有 
BODKE, =K, €)-Kale, &), ECB, (3) 
Hy (A) A PE a, Me 

Kis, €)—-Ky (+, ET (A—-v DAK (+, 2) =0, 

(EEB, A, V0,) (4) 
HK OC, SHERHE. BERA AO, Ki, = 和 或 
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者 所 0。 于 是 我 们 可 以 令 
B,={§€CB| Ki, 60}, (5) 
B = {EBK C, €)=0}, . (8) 
定 尺 1 ARBAB A POU SOM SS it 
界 和 消极 边界 。 - 
定理 1 BAB RB, 


证 ABER, BHETICE KU OCC REBAR 
WM Re, ATK CG, EC RDUBRE OR, FE 
B,= U EIK G, E0} 


EREKE, B-BL= Babs, EH, 
定理 2 ECB, WEC, EFt, KO, SEMA, F 
HK, Ef eR HERR AERK O, Eh KO, DARRER O, 
证 由 (3), KO, KO, 8, HKO, DKO, È) 
“K+, $), PERCO, DIME Ru= imPK (+, HSK, 
E), BKC, DEF, UCA. HEMILA4, u=KO, £), 
系 (AC UuOO RNOR, OORE ra 
Piya {cK (+, SECB, Heo}, 
证 从 定理 2 和 定理 8.19 得 出 . 
对 任意 波 雷 尔 集 TCB， 令 


AVP, fa(r-QEP}= (Ka, Eyp(d&), (7) 
r 
XiCMweE fe tt, (rT— HET}, CE) 
定理 3 SER UR eB, 
ADAST = XT KOK), (3) 


证 XMS RIERA = {ztT 一 0) ET} 是 终极 集 ， 


XE (A)= | erdp( A, ret) 
D 
= S i » ed f z7 g 
K gi lA, TSG 
“7ST + 


- “| e- ULPLA}-PHA, t>t}ldi 


XTA S [eric z=j, O&A}dE 
i a ° 


= XP OA S| eh, Cop, {Ad 
i 8 
=X] -A Dh; (AMS, 


定理 4 HEERE REC, 
xf) = fka, E)u(dé) = | K, (i, Eud) 


T ia Be 
= A), (10) 
XA) ARIE MERE! cA, XARIX O). 
证 ”由 Bb 之 定义 得 (1 们 第 二 等 号 ， 
HO'O) X" = [nx SJR(adE)， 令 pce 得 


r 


XT wyawesey IKO, Oucde>, RERI. REME) 中 第 


一 等 导 。 于 是 由 (10)， 
MX? A) = | MK ce, yuldi), 


_. 
rnis 


取 极 限 知 X"《%) 的 标准 映 象 为 | KO, Ode =X, ER, 


Piit<cole(t-OEB,}=1, (11) 
P{¢=co!lx(t-O)CB} 31, (12) 
证 由 (10)， 


XP’ AY=Bfe t, smr- 0 E R} 
=Ejje-**, T< OO, s(t- 0) € By} 


s Jĝ». 


=f K(i, E)u(d=0, 


Et 


HEGO. BX, 

XPO) = BI{E, et, tlm, r(t- ET 

=E,{@,..fe', too, a(f-6) Er]} 

= 了 feetrr yy to, er- OP EF}, 
取 极 限 知 XC%) 的 标准 虐 象 为 Prco, a(rT-O) ET}. 特别 地 ， 
X00) pape RB Pt co elr 0) CA}. HARE BA XO) 
Ga BR BR Bey NF", Preco, LT- 0) EB} = Pifx(r- 0) CB}. 
HeD, DEB. 

定理 6 设 /9B. 上 的 非 负 波 电 尔 国 数 。 则 
uA) = Ee >t ieir- 0], Be} 


=f sa, E) (Bout de) (13) 
MEERA 
=E{flatr~0)], rit~ 0) EB.} 
| KG, £)f()utdé), (14) 


Ro, mBRi twee otek), RER ABEER 
函数 ， 而 且 


u; = E; firir- 0j, 2.}= xa, &)/(&)ucdé) 
B 


< Oo. ' CID) 
Wu RARUA), 
证 EH 4ER, 
定理 7 (òE) = {fn GE } TB,. 
证 ”指定 jE 5,, 设 最 小 8 过程 区 第 有 这 到 达 j 后 售 留 在 i 的 时 间 
pt. ROSPP;, ef(ncl) AAA, T> Sp? = co ， BPP, = 


w- i 
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cov=1, MIME, PHr=coleir-O)=4)=1. WER S, 
E.€ Bp, 
定理 8 MERICE, 
P{r< jst- 0) CH}=1, (16) 
证 注意 i EH 时 9g; 半 0, 即 j 非 吸引 ,如 果 z(T-00=i, 且 T= %，。 
HAZE Rtt Hra, oj, RIERS, 除 概率 为 0 的 
0 集 外 ， 这 是 不可 能 的 。 证 毕 ， 
结合 定理 5 和 8，P, 几 乎 有 
a(t-QO)ECHUB,, 如 果 T< co (17) 
sit- EB, WMT = co, (18) 


$813. .#1 的 概率 表现 
定理 1 设 1 汶 8B 上 的 非 负 有 界 波 竺 尔 图 数 ，U(h) 按 (12.13) 


确定 ， 则 Py 几乎 有 
æa H], Hae -0) CBB, 
ima (A) = 4 x ] “ie ) € BBY D 
H =a Ü + hat — D) EBH. 
证 本 在 2 上， 


ecg CAD = BO, Ce flat -09], alt 
-OCB)'F..3 
= Efe t f et- 0], rr- 0 CB. F..} 
=e "Et{e frr 0], rtr—0 EBF, h 
当 n->co 时 ， 利 用 束 收 化 定理 得 


lime, (Ase tt, er fiat - Orr oas. 


fi 


由 此 利用 定理 12.5 而 得 (1)， 证 毕 ， 
定理 2 设 波 雷 尔 集 TCB， 及 和 按 (12.7) 确 定 。 则 PY 几乎 有 
mX’, ,= 1; tact — 0 Er, | ° 
me Lo. Malt -O)CB-P, (2) 
证 ”这 是 定理 3.22 的 特 款 . 
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BEF TEB, £260 在 B. 上 非 旬 的 有 界 波 雷 尔 函数 ， 这 样 的 组 
RABAT? ,如 时 了 ,fs EF Auf, 所 于 三 站， W A a 
— PREY, 

定理 3 PHO —- Re RE 

uC) = Eile t flatr~o)]}= | KG, E)E) ned), 


He 


FEF, | (3) 
A) et uh EAA 
wi= EF, {flat —0)3)= | KG,2)f(2ucdé), FES, 
te (4) 


UME MT, UCM, SFOFSE PURE PEO OM, 
wh) = Efe :fxtr -—0)]} = Eet limus, i}, 


(5) 
uy = Ei ffx(t..~0)] = E (imes p A)}, (6) 
flate = 0) 1S imu AOS M, e (7) 


证 ”用 定理 12.6， 如 GE rs, WOO ERO) E #7, 
uo Me, 

Bure #i, LER NES et. WES., 在 
在 B 上 的 非 钠 有 界 波 雷 尔 函 数 g 使 w= Bigfxtrt 一 0)], 依 定理 12,6， 
ui hah pu; (A) = Efe tt glatr~0)1}, W= glr Er? EA 
ut) 有 形式 (3)。 l 

由 定理 1 得 (?) 第 一 等 式 。 再 出 (4) 及 定理 5,7 得 Ee 一 0) 
= imise ,从 而 得 (7) 第 二 等 式 ,证 时. 


S14. 最 小 Q 过 程 的 原子 流出 边界 
POSE el Fit Ch St | 


定义 1 分 别称 Bo= B,N BG, 2) 为 最 小 & 过 程 《〈 或 定 
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EO) ASIF RE FORE. 类 似 可 定义 原子 消极 
边界 和 非 原子 消 家 边界 B,,。= BN B1, 2), 

定理 1 ECB RL, Kit OAR, SECB, K: C, 
DER. 

证 MRE AZAR REE UEI. 2, 46 Beit, 

，5) 与 Ki(。，&) 同 时 有 界 或 局 时 无 界 。 

设 EEB， 则 8 >0。 由 (3.40)， 

lpi(z(t 0) =£) = KG, En(dE), 


; ES a, 


WD 
KO, SHR. 
设 ECB, KO, DAR., TEE, DEKO, £) 的 标准 
ER, 而且 是 有 界 开 HAm, WKO, 2) C.# tia’. 
恢 定 理 13.3， 存 在 B。 上 ROSE fA Borel maie 


Ko, =|, KC, Ofcde). 


FA PE —~ PA FL 18, Efuli) =6 (dê), Mi AKEE) = 
i. Wea, BE) >0, BR ECB.. Es. 

EXI 称 .4T 中 的 元 为 方程 

Au Ou = 0, ADO (1) 

AY AF MAE. Buch) E a tH HRC) OR AMIR ee EAR, 如 
Bu A) eA TEA) HAKA AR |S BY) BR Se Se SEAR PY 

定理 2 B., = 中 的 充 要 条 件 是 方程 (1) 不 存在 有 界 的 非 负 极 
DE Ba = 的 充 要 条 拍 是 方程 (1) 不 存在 有 界 的 非 负 完全 非 极 
小 解 ， 或 等 价 地 ， 方 程 (1) 不 存在 这 样 的 非 负 航 小 解 UA): HOA) 
Fo FP nel) HE ER SY AA 

证 由 定理 t+， 定理 12,2 的 系 和 定理 13.3 得 出 。 


§ 15， 流 出 的 几 平 闭 集 和 最 小 Q 过 程 的 布 勒 克 韦 分 解 


XARA OE. KEM 5.6, WIR RAER A Bd a 
+ 1866 


韦 分 解 (1.2.19) fh, BRB HPS RTA 了 的 势 相 等 ， 因 
ERTIK UAA =B, TES 


FA = {a2(t-0) =a},eCB,, (1) 
F(A) ={et-O) EB}. (2) 
EXI RAAIL FMR, RAAT. WR 
Pir<cw|#(A}} st, (3) 
称 4 为 消极 的 ， 如 果 
P{r=co| ¥(A)}=1, (4) 


BR, IRA PFILE MR, MR ARAM, BE 
FEHR. (RAR SEAS ILE MB, LRA, 
对 于 完全 非 原 子 几 和 平 闭 集 4,， 依 定理 5.6 和 12.5， 可 以 有 分 
RAS Anil Ay, HPA, MA pPMBILE MB, HB 
H(A, J) =f{2(t-OEB,,} = {er O EB, roo}, 
PLA = {rT OER. p= {ee -OCB,,1= co}, 
因此 4 是 流出 的 ,4 是 消 级 的 。 这 样 ,我 们 得 到 最 小 @ 过 程 的 布 
Hy a A 
定理 1 . 设 和 = {信和 ，f<f} 为 最 小 8 过 程 ， 则 它 的 状态 空间 
EA P Fa) 


E=A,.U(LJ A) UA (U 4). (5) 


HFA ALA 025) He BE AS AR SE SEAS LPR, 可 以 
ABH. AGERE, AHWR TILER, AGC BS, AR 
的 原子 几乎 闲 集 。 除 瞬时 集 不 计 外 ， 分 解 是 唯一 的 ， 


S16. 有 限 流出 的 条 件 | 

定理 1 RERET PUL ERRATA 
记 . 

X7(Aj = Efe **, FAD} (1) 


© JF» 


如 果 D lele, Ste. X*(4) =0, Mle, =0, 


证 由 定理 5.6， 在 在 8B 中 向 不 相交 的 波 雷 尔 集 T (AD 
={e(t-Oer ig Bech.) 0, WERL, 4, XA HERR 


WK = Pie- ET}. FH DCR A) = 0 FH DCX = 0, 


依 定理 3.22， D Culece-mer, =0, A S Clr, = 0 几乎 ) ,从 


而 C,= 10。 证 毕 。 
定理 2 the, OCB... W 
1 24 i-a, 
0 %4i+bxa, 
| (2) 
EKER C2, $0.2, BRA, SEM CEB, RR 
mX OFE, RR RRR, TO a aes. 2h. 


定理 3 Bo<cn<co, FMR Str 

CG) 4015.5), A, RH, RAB NB AN, 

GD ity Been, 

Gil) Bi pnt J HAA A 

证 CSA Siew. 

(之 (ii)，。 设 4,，…，4, 为 流出 的 原子 。 由 定理 1, XA) 
(len) MRR. Aik, BE., Mua #1, Bie 


XI) = Bife-ir x(4-0) =a}—> { 


uj(h) = Ble flat — 0}= S Efe tr flecz—0)], 
ü=] 


FLAD = SF(OXIOA), 
tm { 


Bai BBN, 
(i) (i), JERR Pil (A,)}=0 CEB, AR, Ft HE 
P{#(A, J} >0. HT A. Heat, KRERARS THM 
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MILA, MEH, AEETI E. KG) 
ma, MARR, HSU) 的 证 明 过 程 知 ， 流 出 的 原 寺 个 


§ 17 ,一 个 条 件 独立 定理 


BX ={a(t), to} ECQ) 为 非 最 小 8 过程。& 为 了 的 马 时 ， 
P{x(@)=co}=0, Pla<o}>0, ie At RRM Tas TE 
(axa) E, @.7=t,, TI = OTa, iF AMT, Fe AP 
OF (nS lo, EO Reh ae RR. 

定理 1 设 AEF4， 八 EF,-。 存 在 定义 在 HUWB. 上 的 , 与 
zx(Q) 关 于 (4<0) 的 条 件 分 布 无 关 的 波 雷 尔 函 数 /， 鸽 在 {X(T 0) 
EHUB 上，P ,几乎 威 立 

P{@, AJA, 2(¥-0)} =f{z(t,~0)}, (1) 

(1) RAH RSE TE BR |. w(t, ~ 0), 

为 了 证 明定 理 1， 我 们 需要 引用 Imakma[1， 第 782 页 了 中 的 一 
AY ETE, BRIE. 

定理 2 Hie, F, PABBA, EJE <, LCF, Ka 
PR into), KIF, # Je, ELBICHRM, He nN, HC 
<n) WEL’ b 几乎 有 

limE(£|#,) = ECE | 3), 
Hp £2 tS — Ye AOR. 
SIA Fr) EM={X(t.— 0) CH} EJIL PFA 成 
ax. Ak, *& 
Tii, MoEM, t, =T, Te tote 
“to iia CM, 
RACH, — WH, AX =I) CFs, 又 {X(T 一人 = 计 = 
{X(8) =i}. APG .20), 4 XCr,-O) HIE BH, CBM 
立 的 , MASEL ARRAS (a) cH, GX) 关于 28<oc 的 条 件 分 
s 1B9 6 


HER. HCL) ZEM 几乎 处 好 成 立 ， 
RUE CEN S{ X(t, 一 0) EBe} 上 几乎 处 外 成立 ,期 下 证 
TxP{B, A|A,X(t,—- 0} = |wh{X(t,-0)}, (2) 
HK CER GE EN EJLER 
P{0, A, M|A, X(t.-0)} =0, 


Bp InP{6,,A, M/A, X(t,-0)} =0, 
iC) Fe oF | 
InP{@, A, MJA, X(t,-0)}, (3) 


WEA SS, = (TY -TY， Y= Fi, SS wea, 4o Dy) E FB 2 BY 
FERR. BRE, NO2 = 站 8,， 在 8, 上 有 =9.3m， 其 中 = 
Teo ape exir oie Bs 站 m BA I 

WU) = bn Ww", 
这 样 ， 几 强 马 氏 和 外 及 定理 2， 在 名 "上 几乎 有 
EJA), = limE(E) ¢,) =lmE,.,*) 9 
= limu X (t2)}, 
从 而 有 
IwE(é | 2) = limtnu{X (r7)}, 


$y RP = lim ive (X(T) 是 非 负 的 终极 随机 变量 ， 因 而 存在 8 上 的 


JE i Bord AY Wy ae MD = 六 并 (TO = Iwh{X Cr, - 07}, 
于 是 
IEEJ) = Inf{z(t.-0)}, a 
ALAC #, - Cw, rt,- DAA, BOC2) RA BPS) 
AEF 
IWE\ElA, x(t, 一 站 ?二 IKE ECE) JA, rit, — 0)} 

=FE{1sE(E m) |A, sit, — 09} 

=E(isffx(t,~O}]|A, TiTe ~ 0)} 

m int (z(t, ~ 0)}, 
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得 证 (2) 。 

往 证 /在 Be. 上 的 限制 1(9)， a Bex a) BF C0) HES 
AIC, AS Ge IP sb Ab AS eA TR 
Rapti. Mb, REMA TERK: Ha) ESAE, u(i) 
GEEH AIH E A. RR ER Ba AB, AAR R limu (2, 
存在 ， 则 此 极限 与 初始 分 布 无 关 。 在 上 述 事实 中 ， HSE TEME 
aa le] ((a<ig),(a<o) 9%, P(+|a<o)>) LB ees rir), Œ 
43 Fir BRE. 

-上述 事 实 的 证 明 ， 设 分 布 9= oa) 满足 u>, —H i, B 
P, (u(r, Aw) = 1 得 Py(n(z,) + Atv) =1, 一切 二 田 一 方 
面 由 假定 P -Aldd d RRB PTI Rot. 
P(A) = A(G) = 1,4 Be’ ft Sa, vy > ONL Ae ERE 
证 得 P,(ACv) = A(d;) = Alv')) =H=1, PCAC) = ACO) MA 
WAP, (Atv) =ACu’))=1, HRE, P, CAO) = A@v’)) = 1. 
W o 又 是 一 分 布 ， 由 上 述 P， (Av) =ACv)).=1, 从 而 P(A 
(of) = A@))=1, PAW) = ACU) =1( WD P (AW) = 
A(v)) =l 

_ 依 定理 5， 7 ,存在 非 负 Borel mtr, BILEAN =f, (2), 
AY = fi (ae) EP, Fe (a) = Fir) = 1, MA, = fe UAE 
寻 成 立 

BR BACI, ~, ACF, MELO, 24-0} 之 下 ， 
入 与 9, 妇 条件 独 衬 ， 基 在 {x(t~0)EHUBs} 上 几乎 成 立 

P{ AB Alx(t-O}=PLA |x(r—-—0)}P{8,A Ix(r- 0)}, 
7 (4) 


§ 18 ，Q 过 程 的 一 般 形 式 的 进一步 刻 划 


BX ={x(t), Fcohe#.(Q) AERD, ARAL 
Byer. 
Ml vA PARA, 


« J9] > 


(A) = 中; CA) + ` X4 CAFC) 


aiH Bog 
+Í Xi da F; ih, a), (19) 
上 . . 
Hr VA) Ee, x(t—-O0)=a}=¢,,04)d,, a€H, 
| (2) 
Xj Q) = Elet", r(t- 0 =a}, a€ Bs, (3) 
Kila, r> =E,{-**, z(t- DET}, LO Baga 
(4) 
而 F(A) 20, ALFA), 1}<1, a€ HUB, (5) 
F(k,a)20, MEO, a), 1181, HUILE- YE Bez. 
(6) 


证 . | 
Pil A =E | e Fi 人] 人 


= Ei] er 1 Lect) ide + Bi | "en! 4, Catt Jd 
四 j 
= Oy (A) + Bet [Teorey ide, 
出 定理 17 .1 的 系 ， 虐 式 第 二 项 等 于 
Bi{fe- div， [e rlsLrtt Idt} 
[i] 


=Í Biget, x(t~ 0) € da} Bifo, | e7 Ta dt 
D 
R, | 


Fil. 


ae }=| Mth, da)F,(h, a), 


HIB, 


HELEBORO. ETOS, BB SBI, E 
E, i 

8 19， 瞬 返 过 程 及 其 边界 

回忆 全 7 HB See SC DIM it PAR 2’ oe BEEK ra A E BR RE BY GE 
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8.1. HERNHARAS HR ewe. 

MA BX =(2(t), t<o}eC 多 p 为 非 最 小 过 程 。 如 果 对 几 
$— Yu, HER Mico), X(@) FLO, tH PHS AeA HS T 
CES, BXH ORE, MRM. 一 阶 过 程 (或 一 有 阶 
过 程 ) 组 成 的 类 记 为 名 1 CBR? (>). 

BXEH,, WX ATER A WBE, 

=T, Tis Tay rg Tos Tasis 3 Toas Tattae "9 

Tors Tarnagas ~" (1) 

其 中 或 者 对 革 个 序数 aco? 有 已 =c， 或 者 对 一 切 序 数 a<<w* 有 
t,o, Hiimr,, = 0。 


My =ielt), tco}C ao, WX AERA BER, 


Û= To, Try Toy ee t Tay Tatas UUN s Tara A 
Targ, OS ， Tai p tme ， T,,! bomers UUT > (2) 
Ri AK eS Vee Be 


定义 2 MN a{e(h), td} C Pok E, WRXK 
fin(0<n-ck— 1) 6p Rid BE, eae ER aE 6a<-@ "+1 ir, 
=G， 或 者 对 一 切 序数 0 <ce** Ai<o, At asiso, k 阶 瞬 返 过 
程 组 成 的 类 记 为 多。F 阶 瞬 返 & 过 程 组 成 的 类 记 为 名 (CQ) 。 
设 XE PaO, PRAPREXE = {e01,), Tht AX SR 
At, Hoey $8 (8 9) (8.11) EXO RO 
Hi; =Pi{x(t,) =F}, (3) 
BRAS = (CT) Tae Sto SA RRA SEE Pt (8.9) 
—(8 IDEXX. XL Be RAN 
| Hi =P fx(r.) =F}, (4) 
KEELE, En], To STs SARA, HPT, 1a WS .9) 
一 (8.11) 定 义 。 Xr 的 一 步 转 移 概 率 为 


iH; = Py {e(%,1) =F} (5) 
类 似 地 ， 可 以 确定 

Ht CAs Ee ,Tt =P, A0, (6) 

HiQ = Eile tat, gTa nD =F}, A> (7) 
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象 3 12$ 14, MOOME BSW ACE, FRBSUARB.S 
之 流出 边界 Be， 马 享 消极 边界 Br， 原子 流出 边界 Be 非 原子 流出 
边界 B,,， 原 子 消 极 边 界 B,,， 非 原子 消极 边界 8,; 等 等 一 样 ,根据 
:五 和 :IC 可 以 确定 ! 阶 马 亭 边界 !(oB) ，1 ora eB, t 
Brit iA Be, TBR AB, TBP Bei. LSE 
AF RHA Be | 阶 原子 消极 边界 Bo 和 ! 阶 非 原 子 消极 边界 
Ba 等 等 。 最 小 过 程 即 擒 阶 过 程 的 边界 理论 ， 很 多 都 可 以 移 杆 到 
KOR ete PE. PRN, REPRE BRIER X= {r to} € 
Yar MRS 

Qe ={ 存 在 序数 we<o ET, =a<co}, 

2. = {H — By Rake cw" tar, <o} + 存在 序数 

aot! fir, =d=co}, 

H= HU jBeU,BeU++Us-1 Be, OHSH, B= B., 

Wher EAO- 0) EH, EQ ro OCB, BUM EB 


12,512.83% 
定理 1 HX={r0), t<o} Ca, MA — Hi EER 
P,{a<coja(¢—0) €,B.}=1, (a) 
Pi{g=ocojr(o~0)€,B,} =l, (9) 
 Pi{e<os|z(o~ 0) C,H} =1, (10) 
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Soe “有限 非 保 守 有 限 流出 
Q 过 程 的 构造 


对 于 一 般 情 形 HOD HHI. MARRET. 在 此 假 
设 下 ，Feller[3] 对 有 限 流 出 和 有 限 流 入 铺 形 ， 构造 了 满足 向 前 方 
程 组 的 全 部 名 过 程 。 杨 向 群 [1 在 同 样 假设 下 ,构造 了 全 部 名 过 程 ， 
Williamsf1]J 和 Chung [52] 在 保守 且 有 限 流 出 的 情形 下 ， 求 出 了 
全 部 8 过 程 。 杨 岗 群 [13] 中 。 对 有 限 非 保守 和 有 限 流出 《简称 双 
有 限 ) 情 形 ， 构 造 了 全 部 8 过程， 但 其 结果 与 Williams [1] 中 的 结 
果 的 联系 不 是 很 明显 。 为 此 , 熊 大 国 13] 仿 照 Williams[1] 的 办 法 ， 
HATRA RERE, 但 其 结果 与 Felier[3] 杨 和 辣 群 [1] 的 结 
末了 联系 博 不 了 明显。 本 音 中 ， 我 们 将 在 双 有 限 条 件 下 ， 按 Felier[L3] 
杨 向 群 [1] 的 方式 构造 出 全 部 QQ 过程， 并 指出 与 Williams[11, 9 
大 国 [3] 结 果 的 联系 。 本 章 内 容 取 自 杨 向 群 C14]， 


§2. 基本 假定 及 Rs(A) 满 足 的 条 件 


UO = (gd ) 满 足 (1,2,6)，d= 21 是 非 保守 量 ， He = {idi 
> 6] 是非 保 守 状 态 集 ，B 是 由 Q 导 出 前 马 亭 流 出 边界 ， 

基本 假定 设 4,= 好 UB 基 有 限 集 。 或 8 可 以 是 窗 集 . 
LBS SM. RASTER, RË 


inf AD) 61,04) = 0, A>O, (1) 
| 


e yore 


在 基本 假定 下 ，Q 过 程 不 唯一 ， 
Mach, X O) =6, 0 )¢d 52 FOR, B. 
KI TNT =Pyd,, Alo, (2) 
AXi (AO; d,, Aao, (3) 
PEO EAO HRR XONIO. WEBA, ik 
第 六 音 和 13 一 8 16 的 讨论 ， 可 以 选取 列 协调 族 XA) (a€ B,) 


使 不 (= 之 XA), MA 
eed 


Xi (4) —+d,, 0, OEB, i—+b, (4) 
ACA TX, ALO, GEB, (5) 
AX9(A}—>0, ac B, Aoo, (BY 
RI)—>0, a€ He, i—>b EDB, (7) 


这 样 ， 在 基本 假设 下 ， 我 们 可 以 选取 列 协调 谋 XO) Cae 
A,), FER RAK EA, 4 


MO)T=1- 2K), Zh) = DOXA), (8) 
ZZ = Z X, Mo, | (9) 

X = 2 MORIA = 1 ~ Zp Fill Ze O A N h AP A eT RR. 
XA) (acA4e) 是 线性 独立 的 。 实 际 上 ， 设 s CX =O, 


由 (7) 得 之 XA) =0， 从 而 由 (4) 得 "=0(aEB)。 于 是 


aed, 


> XA) =0, 由 绰 理 1.11.6, e=0 (a€EH,), 


eer, 


HOHE HHG 18.1, EANES TARR 


Wish =O) + > XICAFICA), (10 
aid, 
HPP aE AR, 
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wm 


FaAyS0, ALFA), 111. (12) 
引 理 1 对 于 (10) 中 的 VA), RRS TET acA, 


GDR, MADRS THR E A. F 
Fw ACA, p= F(u) + (p=) 之 LEF), ew 


Feu), (12) 
BEPA DREG. 10.7, GVEA iF 
Foch) F(u) =u AF CAEL) 5 (13) 
IFEF Aa EH., A 
limAF (A ) =, 7 (14) 


证 关于 范 条 件 的 必要 性 条 件 (11) 已 在 前 而 撕 出 ， 充分 性 由 
APAL =1-— >) XA) + KANNALP CA), 1] 


及 (11) 得 出 ， 

WO PAYA) 代入 预 解 方程 ， 由 于 6A) 满足 预 解 方程 ， 
XA) (CAI BAD BRM BEA, RY) 的 预 
eA Bir 12), Hao PAA FRA C39 138) -3124 
tt. 

HERO AEROS RA MARE, 我 们 得 站 A}8 的 条 件 等 
价 于 

limAXF (ADF O) =0, GEAS, 


EDA; Eo Fa EHAA, 


$3. 问题 的 简化 


EXI 设 4 与 5E 4。， 称 s 与 5 为 不 可 办 的 ， 如 果 对 一 切 X> 0， 
有 F(X) = FA), 

显然 ， 不 可 辨 关系 是 一 个 锋 价 关系 。 TERY BEE FR FY DE 
A, 分 解 为 互 不 相交 的 等 价 类 21, 42, , RNS TAB 
gs 视 为 一 个 新 的 边界 点 ， 并 是 记 
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A={a,, ites ver} AzHUJB, . LED 

={a,acCA, aN H= 4), B={a,0CA, aN H= t}. 

| (2): 

记 Y= SX Y= > Xt GEA, 440, (3) 
bea 


K2. 10O% 
PA= daO + SY AFCAD, (4) 
中 三 过 


AYE RY Ft SA BB AE BT BEY. 
引 理 1 {ET RICARA x TERG = (G), G 的 每 一 列 HB 
不 是 零 列 ， 而 号 满足 


Gt>0, DGV<1 (GEA), G*= 10acEJ)， (3) 


bel 
使 得 
Fai) = D GFA), aC A, ADO, (6) 


bef 


而 对 于 cEJ，Fe) 不 能 表示 成 下 面 的 形式 : 


F(A) = > RERA), A>0 (7) 
oa ! 
其 中 
- Raa 一 个， h®>0, Shei, (8) 
ber 
tee) we Er F(A Ac OCa EI), 


证 FET RICARAXISMGH (OS) (6) 成 立 是 明显 的 ， 
AMA, GA PCR TT 但 此 时 可 能 (7》 (8) Mita 
EJAY. | 

PEATEICARBRA x JRGH 0 (6) Rat, MAFF Æt, 
El, 使 (7) (8》 对 a= ao 成 立 。 出 由 (6) (7) 得 


FeO) = > GIF), aCA, A>, 
ses, l 
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HAs, = Je {a}, A xJ ÆG, = (GI MICRA 
Gjt= G% 4 Ghb, goa, bET, 
由 《5) (8), GE 
G0, >) CPIE A), Got=1 (ETa) 
bila 


et, HI RA XI EREC RAMCE, (5) (8) mae. Het 
手续 继续 ， 兽 可 以 得 到 子 集 /及 A x REC >) (6) mot, m 
对 每 个 ecEJ，(7? (2) 不 能 同时 成 立 。 最 后 ， 邵 果 G 中 有 的 列 为 
SA, WHAT -{OCF, GROW) as A) ASS MR 
R, 证 完 。 

引 理 2 每 个 台 过 程 内 有 有 形式 


iA = Gish) + DEO), (9) 
aif 
Heb PRI CA, JA A BREE BBE, i 
ZA) = SYU(A)GS, DES (10) 


是 线性 独立 的 列 协调 族 ， A x SIRS = (G%) 的 每 一 列 都 不 为 零 ， 
满足 55)， 使 《6) 成 立 ， 对 每 个 gEJ，(7) (8) 不 能 同时 成 立 。 
Rp, FOOSE. | 

证 将 RA (4) 即 得 OD. AF XA) ac AERE 
独立 的 烈 协 调 族 ， 因 而 可 得 (10) 中 的 Za) CHET) 是 线性 m 
立 的 列 协调 族 。 剩 下 的 绪论 由 引 理 I 得 出 。 

引 理 3 HOtRVOR A BepMBAS. MQ) 的 范 


条 件 等 价 于 
FA) SO, ALEA), 1l1, ae dy © ID 
预 解 方程 等 价 于 . 
FAAC, M) = FOC) + (A) DLR), Zw) EFA), 
acy (12) 
ORK Sit T 


~ 


limAF(4)=0, @@ Jy, . (133 


s (99 « 


其 中 
Jyu=J 0H =a EJ, afl H,-o}, (14) 


fe=F)B={ael, aN H,=¢},  - | €15) 
T= Tl 17s, (16) 
证 ”利用 引 理 2.1 及 引 理 3.2 和 将 出 ， 
记 l 
Zt= D Y'G*, bEJ, (17) 
Z*(A}= ZA) ~ 2K) = EAL- Se), 
bel Ted bef 
(18) 
Z*=Z- DD= BY- He), (19) 
baf aca By Ff 
刚 显 然 l 
ZCA) tZ EJ), ZECO tZ, ALO, (20) 
XT+Z*+ > Z=1, (21) 
84. FOR 
引 理 1 gece, M 
CRISA, wise. igi. (1) 
RE lo lites ERA Ss ES A 
C,, =1+ Jew, (2) 


证 HAG, VAEN | 
oA, Ital + vrigl » vevi] 


<a) +4=*!r\9),~13= Ca Wal, 


EC) 省 边 的 不 等 式 。 龙 边 不 锋 式 由 
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Eo FF FF 


Ig =}GAA, VAW, ADC, GAG, vl 
得 出 ， 
引 理 2 ” 设 非 零 的 FO}ytaED WE G.1D ® (3.12). W 
FERAM), BCI) RUA RO.) (a CIE 


Feay= D MAAJO), aed, (3) 
bir 


fo HIER URMO OOH A F PIPER: 
(H mA =0 4HR HME) = O(a Gl); 
CGD AEJ x JIEM EEH = (HH) 个 


BA = D HPA), aed; (4) 


bof 


(ili) PEE acD fei Fale omy 
O MhU a 
IFe(ny ACh, Y) | 
Ray 0, RFE AIR MP, 24 = ucok}, 


Fema 
ah, p= at SMA) en 


Hp) = H, a, BES, (5) 


(62 
证 BARTER, MEA, woo FOYA, D EA, K 
mk, HAO, » WE, 4 Arei, SER. SACRA, 
mF 03.12) BAYER, Arw E. ARES, CD 
FA A DiS. 
AGHA CH, AD 到 (3.12)》 得 
Fe(h) = PMV A, BIMCYs, A, E), (7). 
be f i 
APY, > OR. E 
Mhi, A, RoC, BPP CWOIACH, Vi, (8) 
OWCA, p) =at G~AILFCAD, ZHI, (99 
Feo py Acu,2) 


一 (10) 
WP ACK, Y) 


acy, 入， H) = 


* 20] » 


显然 


Inv, v, # i) =I (11) 
由 1.10.9 RYE, 
Cilaja, A, OC. , (12) 
CAMO, h, DEM, A, pC, MBG, 4, BY, 
(13) 
在 (7) hiv = voog 
F(A} = S My, a, CV, A, HD, (14> 
bef 
由 (12> 得 
> SMV, h, CT, (15) 
be f 
Cy a ab (16) 
p= DM, h, p), 
ar 时 
al, Æ GD pA = vee 
Fo) > Mev, v, e), (17) 


bef 


FE, WHEPOCI, MA | 
lim M*(v,4,2)=0 W—Hv>o, Ao, a€, OD) 


pe oe 


或 者 
limM*(v,k,#)>0 MEER YY>0， 基 个 k>0 及 某 个 


l aed, (19) 
由 (13)， 上 式 等 价 于 
mM v > Oxfst+v> OF pa CT, (20) 


H m 


设 使 《18; RAe EJA Gau W-Gr., HAD 然 
的 话 ， 从 (14) MRAPA) = 0, SPAR AT RIES Mr 
me, At, #8 I- Go, vOb)>0, b P €IRF P41) 
co iil | | 

Ma thetv bh ), VCDi), BCE) 
. 702+ 


——> Mabe Be (V(b) >0,: (21) 
Mis 1 成 立 。 设 向 外 = 4.1) -—— > ott, 1a) mands OCI Sika 
Gi, WE, oG,, 6,E€4/-G,, MERGE, U{o,s=f, WRF Fe, = 
pL). BR, FE, EJ- (G, Ufo}. vib.) >0, afb, CIR 
DATA DED i= 2 mor, BPRS, FRE EA 
={6,, ba, ++, 石上 于 及 6 人 DG 人 DT) afb ET, vihi), 
PCa), VCO), FFl, (eB 
lima M** (vA, Ha) = 0 


机 c 


对 .b6 FJ -AB—acs, v>o, A>o, | (22) 
limM**=<(v(ce), vie}, Hy) 


= MoD D>, CE A, (23) 

BaD #17), AAA, Ae es, i 记 
Ale, BMBEPOCA, A | 

limM™(vic), vej, ta) =M*(V(e)), a, OCF, C24) 


limy; Cv ce), Ve) Bad =m; (V(e)), bE, JOE, (25) 
iy 
MtOe(vceyy>OCeE A), M®(vie)=0 (CCEA, IE 
J, b€ I-A), (26) 
E (14 P4A=-v= ve) 


Fey(e))= > M*(v(e), ve), wa (vc), ve), 2), 


Bef 
CEA, (27) 
&u= ,一 > 00 44 
F*(v(e)) = > M*(v(e) a(v(c))), (28) 
BoA 
从 而 
JEn = > M*(v6e) | ave) ff, 《29) 


E 17) 中 令 v=Y(c) 并 路 极限 得 
e203, 


Ce per 之 Me*cvie)), (30) 


ry 《11》 BE HS LAB ACC) Iti tcE A, BES), HR (29) 
(30) 得 
iD) L=1, GEA (31) 
XF, 2S GEA HY, nivo), wib), po FRA PR ae + 
mWivib)), AMR lativid, vib), wl=1 BRU RT ER 
weve) h=1, AA fe Cl See Ss Sr ee, 
FEC), VED), Bal VED -gs GCA, (32) 
记 
PA= gi DOA (vD), A), 
MOGE 入) 显然 是 韭 零 行 协调 族 。 由 引 理 1， 
6 
Cy lV), VEE), py nobla, (83) 
现在 ， 对 每 个 zeEJ 及 A0, AURRA, A, 
使 2 
M®(vb), A, >M (A), BEA, (34) 
在 7) Sua 所 5c0 并 注意 (34) MM (222 得 


Fe(h) = > MHCA Y, 


BEA 
WM OET~A, FEM WA) =0, M*A)=0C@E)), RULE T 
(>) BG, WR ce, 
HD, RHA 
Fem), 


oh _ tal 一 HY b A ; 

mA) = TRAV] 2 CH) HPA, (35) 
其 中 v,=Vv(a}, 

Moacp) Me in) 
He o OLOO = 一 - -一 一 一 … 一 一。 
OS TEWARY S MAG PT 
. bel 
(36) 


因为 
s 70d 9 


SHtal = 1. (37) 


MMSE AR, IEOS bET- A Bt, Hem = 6, w Hu 
We MRT ATA, (5) 中 极限 存在 县 有 穷 。 

Maq*(\) 0 WY, Blac A, A (33), nA, Hd = CV, A, 
HO FRU ERP yA). Fee aA) ORT, H C35) CO. 
aA) =oOmt, ROAM =oCbEF), (4) Bema. S| BES. 


§5. aFeInT 


EU 称 行 协调 族 (9() A> 02 Bi, MEMA] = 


o; TERPSTRA AY. MRO OA) WRG. DA 4.309, 
$F Pn CAPPER A, PRY A SERIA. | 
定理 1 (i) HAL= HUB SAHA. Ha Ua, Us, W oe SE 
es AUG PASE. A = {2,,0,,-"}, RAMFES PBS, J=JuU Je, 
其 中 
JF=TfaET aC Heb}, Js= {at J aNH,=$}. 
(ii) FRA «x JSG REG = (CG) 满足 (3.5)， 而 且 G 的 每 一 列 不 是 
零 列 。 记 | 
ZJ = VS DXEG*, Za 9 D XG+, bET, (1) 


acd cea aed cea 
Zh = ZA) — SZ) | 
agd 
-S(3x@) G-E) | w 
acA eca l bef 
Z*=Z~ S2= SEX De), | 
aud ag fee _ bef 
(iii) BEES RISER APB nA), Aoa cd) 
ah) = NC gra), Zt Ws, A too, (3) 
Were cA = CH ONY, Z*] 4 Fee, Nf co, C4) 
=AL), Ko], Cot), - (5) 
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a= limk HA) (6) 


Ao 


使 得 
o+ Wee S Pty, (7) 
beT 
@=0, Mee de. 7 (8) 
(iv) + 
BAD = by A+ SE SIZE (A) RA), (9) 
f aefbef 
其 中 Jx IGG 
K(A) = (KAA) = U= W +W A), ] C10 
Ww) = (P80) A = Af oo, , 
mi = (6,) BI x JAS, 
WU CA DF FE Be A Oo Re eC A ARE Bt at Fe SR 
We=9, + Sms=1, GD 


belt 


YO DEBER, MARS o, POF, 4A 
=, A (12) 
PETERPAN BY OORT WEE RBS. 
证 (一 ) 设 Q 过 程 W(%) 是 非 最 小 的 ,而 旦 是 非 裴 的， 
特 (4.3) 代 入 (3,117 和 (3.12) 导 得 
D> MeO) tS (A) + SSCA, (13) 


bef hej: 


>, M*A P(e) 


ke! 


= > (I-S(A) + MCW (nh) T), (14) 
bel 
HOP WA) = (WK), SCA) = (8%(%)) 是 J x 了 和 矩阵， 
WAA a ACN CA, ZJ FW, A4 ce， (15) 
We = AER COA), ZIA WwW, Ato, (16) 
=A) X° EAR, (17) 
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Ss (A)= > MEOW), (18) 


ec? 


S** (A) = > MEAW), (19) 


eal 
FAA SESE, W= (W8) RW By a 
THe RF FA» oo jE 
Mir A, SOCK)» Sm, 58 (A> S0* (20) 
显然 S“，So* 者 有 限 。 往 证 M“ 有限 。 
35a (h) = ORT, IRMA) =0>M%= 0。 设 A= {bEJT, A) 
0}, H(13)(18)(19) Reem SAA 


Mor + Se¥ + Sl StI, (21) 
Lert Bel 

>> TV =<. 57" ' { 92% 

ce? 

D Merwe St, (23) 

e: ff 


(的 定 o0.0=0)， 从 而 由 (231) 一 (23)， 
> MALN (A), 11= > MALT AD), 1] 


EEL ce S 


= > M(o° + Wee Ch} + Sw) ) 
cert 了 Bef 


<x Meg + SM Wer > (a Mews) 
a be? ee | 
Heo CART, Meco, EE, J x 了 矩阵 M= (MHAR. FE (22) 
《23) 中 等 导 成 立 ， 


在 14)? 中 取 极 限 得 
> Ment Ch) = = (I -MW + MW ())"F* (pd. (24) 
hear 
P (A) = EMAN (25) 


ac 
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则 (24? 成 为 
n= SU-W+ Wnt (a), (26) 


注 登 (BASHA. 实际 上 ， Mate =0, W 
Wen =0, Fe-0, MH 2OBR (i) =0, Wg Fe) 的 非 零 


BEII. CRE ul n°), 11>0. 
EEEF -Fondets BETA 
We Peu 


eas 


> We ~ pl gen), 1~X*-Z*] 


cil 


of + Wee 4. > Ve u] nec), 1] 
ec SF 


Sle ated, Lill. 
FHEHHRRUIOA, FEM, WHA . 


K (A= > CV -W ADD, (27) 
a= 由 f 
C26) 
Fe(ny = SK Cunt, (28) 
bel 
从 而 得 (9)， 
注意 到 
limK (4)= X (W -W)*=4, (29) 


HC 285, OF FFCS.13>BNCS8). 
(二 》 设 yA) 按 定理 1 中 的 (i) 一 (iy) 确 定 。 


AA 
FOKA) -1+W, 
由 (28) 经 简单 计算 得 
ALFA), 1J=1- DK) (1 — o- W 


bel 
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- Swe) D Keo WW ON), C30) 
ec} bef 


LAASAP SS RU REBRAE CT) PSS Mem BW (A) 
= Prb EJ), BBB (1.11.404 
(BICH), ZCA] = W*Ce) — PO), He As 和 时 ， 
Cmte), Z*(A)I=0, MIL aCe), ZtI=0, We*(n=0, 这样 
W* (A) = Wee Set Pe = 0. 
容易 计算 
KA) (WA) ~ Wn) KCB) 
= K(X) (KA) - K) DK) = KW) ~ KA), G31) 
禁用 上 式 易 验证 对 风 gxX) 的 预 解 方程 43.12) 成 立 ， 己 经 指出 〈8) 即 
ARIF., TAYO SEIR O. 
(=) 设 %(x) 是 B 型 的 ， 即 8 条 件 满 足 。 往 证 Ja= 0., MROR 
守 ， 嬉 论 平凡 地 威 立 。 邵 果 吕 非 保守 ， 由 定理 1.12.1， 在 〈2.10) 
中 有 FN)}=0 CaEH)， 从 而 在 (3.10) 中 及)=0 (Eta), 
但 由 (28)， 每 个 Fe 二 0 (CJ), FRM ease =$. EZ W 
果 J= 矶 ， 风 每 个 aET= 了 Ts 有 (一 怠 )Z20A) = 和 0， 从 而 %(A) HBR 
HE, BCA) EB i. 
PRIA PS PES tt $F | 
0= S SZ KEN) PODOI- O) 


本 人 
= EZ(A) D K” (A) æ, 
aer Bl OF 
HZ OEDEEM, KORTE, EAFA =0, bE, 
H(8> , XA F2). E. 


§6. 一般 构造 
引 理 1 es, 903.11)13.12 成立。 如果 对 基 个 x DSO 
es 
SMA ALPACA), Z*)=1, 1) 


a 209 + 


=. 一 一 -一 一 一 一 mm 


WEY? JEA 


HV. > OE neve) = 1. ee BW) 5.15 SE. 
证 hO) 63.11), HOC, ba, WAALFA(AD, ZI=0, 
从 而 XLR ,ZICH)] =O, RECS. 12) A 
F*(K)ACK a = PCa) + Cu AEEA), Zr Pe), 
AP (nO, i+ (ea -AC F(A), Ze) 0。 仿 定理 2.2.1 指 证 
H, AFEIRA) A OR RC 


& =- _ TO? 
P) = rs >0. 


由 (1) 知 cr = 0, 从 而 (2》 的 第 一 式 以 及 (1 对 一 切 A 0 成 立 ， 适 当 
地 将 六) 规范 化 使 lacy =1, WD BAR. iE Sc, 
定理 2 () 按照 定理 5.1 中 的 Ci) CIRM A J E ZA), 
ZA) GES R2* Za aE, 
(i》 取 J 的 于 集合 LCI 可 以 是 空 集 }, 令 
p= {™ Mec L, 


0,Maei-~L, 63 

(iii) RARE Fy PB 1°00) A 0) oe CI, Te 

limal 920A) ,1-Z#1<00 aes, (4) 

成 等 价 地 ， 按 (5.3) 一 {5,8) 和 的 记号 

Wet<co ,PPe< co ,a bel ab (5) 
(iv) 取 非 负 Tx JEES = (8%) eae 

Su = 0, SSW Stay ,a,6CF] ated, (6) 

oy Pre S FOL, agl, | (7) 

buf 

(v) ERCP BO: 

(LPi WP)! = 9, MHC Iy, (8) 

NOLLA + HW) =O tac Ta, bE] (9) 


#270 + 


REI x THE RENO.) | N= (Na) ,ht 09, 
NGO) = UR (A))-1 = SRA), 


ayo 


arhan Rar a IH- WA) 
RA) = 0, R®(A) = pipra CFD (10) 
N= ER, R = (R*), (12) 
aa — ay -一 六 ”一 Wwe 
R= 9,R Paws (a9), (13) 
(vi) + : l 
Pulse O+ 5 ZHAIK* Ania), ap 
a ,6a 7 , 
其 中 Jx JRE 
RX)= (ROA) ) = 8 + WK) = NANDA), l 
(15) 
TEME, SECIAMARTAHNA ABBE, DORIARRA 
De (h) = Tr yi GE1 (165 
Fey Xf Fi ZED Et BE 


WPCA ROTH. BPOMMOA) 都 可 以 按 上 述 方式 得 到 。 
过 程 不 中 斯 当 且 仅 当 


Br =0, + Seal aC, (17) 
1. WES eA, Woe J-L, mM 

AL Ph) 1) = Wa) > 0, | | €18) 

a E AYO 

FA) =, | (19) 


实际 上 ， 由 (6)(7) 得 (18)。 叉 由 
F'(A) = $ Kx WFA), 


aT 


E E E 


T = SI- 84 OFA), (20) 


bef 


由 (6)(7)， 上 式 成 为 nO) = P(A FCA), MICO), 
定理 2 的 证 明 
(—) BYO Ont. 15.13)(5.14) fo eeae, AS] BA, 
可 记 
L={a, EJ, SO) (21) 
4 
1-5), iacl, 
ý = AG v AET- 22 


Mja) OL e600) 5.13905 1p 


> MA + Be A+ D ROADS, (23) 
bef bel 
> Mea = SCL FCA) + MAW ha) OF Cp), 
ret -” , bej .i 
| (24) 
其 中 
MN) Sth) | 
ak = ~ gd = FEO aa T A 
M A eA) a (A) 0, ree GAY 7 | 
， ShA) 
BE Gy ba) 
| (25) 
满足 
Bn) = 2, MEWA), baa, 
tE (26) 
Se A= S oa We ca), 


eel 


TEF 4. 2H A lee, ERR FA co ff Rf — Ba OCIA 
MM, S%*( Kj» BH, BR 8, (27) 
由 (23)(26) 及 法 都 引 理 得 


« 272 + 


> Maat + wes 十 > Bha, (28) 


he? kof 


y= 0, A > Mowe (ha), 
agf 
而 9 > Mewes . 
eel 
(2) oo * 0= Neco =f) 
BR S*aACHRIx TER 8 = (FFB. HK IRE 
M = (MHRS. 
qaCJ—Lit, H(4.6), Mes He<o0(bE}), FMRGEL, 


(29) 


&> 


AN = fe, CEJ A= 0,0 + We + Sw*=0}. 


bag 
inn (2) =0, WEM O)= 0a Es), MMAM" =0 (Ee 
H. WES, HeCs— A， 央 由 (5.,25)5.26) 有 


SR" (ore wens Swe) 


eer bac 


< > Mert gt DS POs, 


cel hes 
Ww 型 w eo， 对 c EJ 一 八 ,aEJ, 
注意 cE 八 时 ， 


EN) ,E21 = of + We p+ SW) = o, 


isa 


Mm aLa, 1i =") 0, AA 
ELAGE) WP 2?) = WA 0, (30) 
因为 


SOS Peo wear) 


bhefeel 


= SM a) DWI + D MOWADE), 


一 el EEA 


= 2i3-» 


KDOR AEA 
D ME) Cyr) — Wee Fn)) 


FES, 


= Focu) > Bek) Few) 


bya 


+ E moo Swe Fy e) ), 
bel 


REET 


ER e258 
T MOWE) = SC) ~ SS (ASCH) 


Fer be 


+ D MO) > (WeSC) — Wet) )。 
bET 


EREJT=eA 


Maco, ARRAS. ANERER S. HEGO. R 
们 得 型"<coteE A), R SORT CM) A BER, 
在 (24) 中 令 hA 一 co 得 


> Hm (w= -BA RW) OF Ca), (31) 
b+. F 


悄 若 记 


Ate) = >` Mn), | (32) 
bal T 
bh 28) €29)¢(31) RR 6) 07 
no (w= DA- B+ WH) oF), (33) 
Bel 
{E ak E PE 
Ki(pm= (I +~S+Wny)-? (34) 
F245 TH ELSE fh. 


EERE, I- S+Wu meme CAE, EHAR KR 
FE. VEER, REMAKE. Yces-Lint, H 
(6)(7) 知 ， 行 和 等 于 W =E 0) ,1]>>0， 当 a EL 时 ) 必 
En to, Aine) =0， 则 从 (33) 得 


+ 了 了 学 


一 ab 
F= D S Ftp), 


beT 


BD (3.7)(8.8) 对 h = 成 立 ， 由 引 理 $.2， 这 不 可 能 。 所 以 
Hac LRA ae) 40, ,从而 由 (4657)， 行 和 


一 ab 一 Ob 一 一 1# -一 ab 
1~ ~ 5 + EW >1~ (m+ S + > S eg 


be! bef 
* — ih _ 
+W +> mE 11> 0, 
b j 


tHE, (15) Bey, MAM G9 得 


F(a) = SK AWA), (35) 
bel 
得 证 (14), | 
(=) 由 AD 及 10)--(12), CRH T 
DS NAL Wh) a-9, aeJy, (36) 


A N= Eda, ESAT), 
O(S) PPOO Eh Gai E 

注意 WX) =KA)-I- 8， 仿 定理 5.14 关 于 范 条 忻 的 证 
HAR ANALF CO) ,1] €l, HEFELE A7 R., 

对 于 GO PRK A), 63D PARL AMEK 
预 解 方程 成 立 。 已 指出 (2009 FTR. MAWA) Ot 
E. EREK. 

定理 3 RVOR EPRORE., MAABARA e 
FErz: (4) 为 F 形 的 充 要 条 件 是 98"=0 Cad), 


证 RES.. 
定理 #4 RYO EE MAH Ore, WA ESERIES 条 
件 是 
Jim% ge j<, aE, (37) 


证 OHEQ37 ARAL, FERNS. PO) SER. BOO 


«2156 


FEAR, MIDARA (3.9) 和 4.33, IPE 
lima | A) | <, @EJ, (38) 


PO) AR (5.9 Al (6.14), AZO), a IRE 独 立 
Hy. ÈX 


D KIOPA) = SK MA) na) a ES, 


Bel bet 
从 而 
rO = S| Emra [ra 
beJ 
ARA, p) 


nu) = Z| EOKA) rw, €39) 


bef 


wl yego = ZL Kay |” wi iy |, 


A ERR (38) 037), 证 

O E 在 @ 过 程 %() 的 表现 《14)》 H, MRNA), a EJ 和 
WA), GEIS RPA), pa fe A EB (39) AH, FE 
dx JEPER = (ra), SERGE FEE, mE 


A) = BreA), A>, 


bgt 


和 7， 等 价 构造 


定理 1 (i) 闻 定 理 6.2 的 Ci)。 
‘I; 到 非 零 行 协 调 族 cA), A> 0), GES, të 
limi [PCA ), 1- Z*]<00, 总 所 本 (1). 
eS tr Hs 
Waitec, Whoo (ha), a&l, (2) 
ciii) 取 Jx 了 矩阵 了 = (Thi 
« 216 本 


ots ~ Wert ST, (3) 


Fa T 
Wee Te (ba) (4) 
(TH+ Ws) -lae= g, FE Sy | <5) 
下 (了 中 十 W)-igt=0, a€ dy, bEJa, . (G) 


3 I x JEEFO y = (F8(K)) Gf F= (F*, Atco, TJ xJ 


FA) = 人 TO) y= SVA F= SV, hto, 


m= 【| 


而 VA) = (VOA y Y= (V%), AP oO, 
€ — Ta) — Weck) 
ad — ag T eao u a ao 
Vary = g, VE) FEWR) (BEA), 
t T+) YF ob | 7) 
od ap. `T ZF 
Vo. o,V poe, yas (Oa), 
V) 念 
Wis AHH A+ DE DZKA A), (8) 
ect act a 
其 中 | 
Kt(a) =(T+Wia)p 7) = CF - VAD) TEA), (9> 
而 
ECA) = diag{ (T + Ways}. (10) 


Wy A) BIER piOn. EAE MO aap A He 上 
述 方式 而 得 到 。 
注 ” 当 Q 保 守 时 ,定理 1 中 的 %( 和 ) 就 是 Widiams [1] 中 的 构造 。 
定理 2 PARES. ERKO., + 
Tale S ,n(aA)= JA), E, (11) 
NYO) ERIE ROME, RS, BRIAR CBB RNO 过 
H. $ | 


L={a, a€J, T*>0). . (12) 
Sr-0， S%=0(6CI), MBMaCI-L, 
一 a* _ 一 — Jab | {13> 
5e = -元 S*=9, §%s ac 


= Ziz" 


myn), eet J- L, 
MoC) = (EA impact. (14) 


WAFERS. 2 ARMOR. 

定理 1 和 定理 2 的 证 明 

设 $CN%) 具 有 定理 1 中 的 形式 ， 按 (12) 一 14) MEL, 5”, 
S= (Sh, WAGES), My 具有 定理 6.2 的 形式 ,因而 WW 和) 
ROHE. 

设 六 以 ) 是 过程 ， 依 定理 6.2， 它 必 共 有 定理 6.2 中 的 形式 ， 
按 OD MET =(THRPA), EJ, MIARA ELHA 形 


88. 非 双 有 限 构造 的 注 


注 1 HA. = ,UB. 是 元 限 集 . HERA. Ha, Ua Ue, 
集合 站 = {91,9; OA MARERE., REA ETRE E 
的 ， 或 络 7 蚌 无 限 的 ， 但 在 定理 5,1 中 接 (5.27) BREAD, E 
理 6.2 中 以) 按 下 式 定义 ， 


K Oy ={ ER Day, 


RAY = (RA) 805.103, EDA an (5.16) 
ARSE BET IPKO ETHEM: 


Ka) = f Evaro, 


VA) = (VK) BR C727), SAREE 7.10). RE 
THES., E6., EM. 1 SoA MAIER DWOW , 

+2 BEHER, BAR, PFA MIR. A={a1, dzs 
terer bey DE CPR AY. RARAN EETEHI = OC ERY, J 
必 有 是 有 限 集 )， 则 按 定 理 5.1， 定 理 6.2 和 定理 7,1 构 造 的 %X)， 是 
满 是 向 司 方 租 组 欧 非 最 小 @ 过 程 ， 而 且 此 时 定理 6.23 或 定理 7.1 构 
造 的 & 过 程 已 穷尽 了 满足 向 后 方程 组 的 全 部 非 最 小 的 4 过 程 。 
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第 四 篇 “可 列 马 泵 科 夫 过 程 的 轨道 结构 


B/E WARP ANGER BB 


$1.31 F 


王 梓 坤 教授 在 研究 生 严 过 程 构造 论 时 ， 引 进 了 过 程 的 9, fe 
变换 和 强 极 九 概念 ， 并 成 功 地 用 概率 方法 解决 了 生 灭 过 程 的 构 艇 
fale, MERELS, 7], SPM SBR [1,21。 甚 基 木 思想 是 
将 一 般 的 有 比较 复杂 的 轨道 的 过 程 变换 为 有 比较 简单 的 轨道 的 过 
程 .然后 证 明 一 般 的 过 程 是 简单 过 程 的 强 极限 ， 个 振 挺 教 授 F3] 将 
9, 变 换 推 广 到 一 般 的 可 列 马 氏 过 程 。W 变换 ,是 g、 态 变换 的 进 一 
步 推广 ， 因 而 王 棒 坤 [3]， 王 梓 坤 与 杨 向 群 [1,2] Be HEBEL 
Hg. fn 的 结果 都 可 以 作为 我 们 现在 的 结果 的 特 到 情 培 而 得 到 。 
本 章 内 容 取 自 杨 沿 群 [7 ,8]， 


82. WERDEN 


He ote re ot BW aie, BEX = (2(i),t<o} EM RH 
Loo(oxco Me pF=EU {oo} mae. Beit, PLAX 


Q=T 8,87, <8, me SO, (1) 
ATR, Bh + 
Ü, wWRNn= 0, 
Fa 一 i (2) 
| > CTh Bia), WANDS O, 


A=] 
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s= D (Pim te), WO. (3) 
站 一 站 


T= limo., ð =limé,. (4) 
WEEO,5), + 

a, =f, + (t—9,), MAHET Tatile (5) 

E(t) =z(a,), ECOD). (6) 


定义 1 将 函数 和 = (x(t), tco Ep me = (Bt), te} 
SEER, RA AR aA, 记 为 多 :rr。 于 是 加 = 全， CX), 

EMH, PER MA Fr BG ARE, Sat 于 
[hit 1 的 那些 段 并 和 问 左 移动 ， 使 [B。,?1) 称 至 [0,T1 -~ 有) ,其余 
WCB, Tuil, 2, 4 RRP RAPA, HRP R 
BX | 

fa GI RT RS ER, AY ee SC BX WV AB a 

E2 RX={2t), toh eH, BRUE TOER, FF EB 
{r(@),2(@)>}, AMT BREW, oreo) (X(@)) = Xo) = {3(t， 
O), $<7(O)}}., RRA MRC Wem, WAX = Ww, Xd, 


$ 5， 强 农 限 定理 


一 、 站 为 画 数 的 情形 
 ER1 WAAL, PARTIR, BRO DAANWRE 
li], RE 
Ci) (Am) CAS; 
Gi) 最 大 性 ; WELA, TDA, mD ACA, 9) CA,RIEA, 9) 
=LA), 
TEA BY 4) Be DE A] PRAT A AYA). $ 


C(A) = J (Am, C1) 
[nu 

CAs [J cm)， (2) 
[karieu d) 


e 720+ 


CCA) = ff 存在 严格 下 人 降 的 1 EC, (A) EET} 
= {f | Bee BL CCA Lt}, (3) 
PRCT ADA ARABI EL. - 
定义 2 PREM uy (4) At 8} ae R(t” 8} Ce 1) 
所 确定 的 变换 ， 如 果 
yu) =L{A [0,4 }, (4) 
A LA By SBE, Hi : 


j | Bp „Thy ids MF iit, 8}, 
As) 


on (5) 

LJ LJ CBE ted. HTPR, 8}, 

定义 3 BRER = {z(t) t< HAREM, ME 
lima(s} = w(t) CH, Hyi co, (6) 


定理 1 HX-={1G), t<o} WARM, FERRIT, 
Bins) 4 
At= (JEER TR ONA. | (7) 


fend 
Hy" y 5p Bll Ay A H EnH A Lt", 8") De it” BY} Ca) Bea E 
RAE, $ | 
t= yee), BE =w MAn, (8) 


Wat (X)=X"= fet), t<o*}, (9) 
BY iy {te Burim <m) Xa BR, 
mH. X=W. mn BUCK"), MH, (10) 

cii} yn oo iif, 存在 极限 

otr =LA), . aD 

lims*(t) = g(ar)， 对 一 切 1 E 上 0,5)， C12) 
其 中 6, 是 方程 

L{C:(4)nmroazyy=ty 7 

3) 
weC(A), j S 


e A219 


的 唯一 解 。 

(ii X=f{xla,.), tF AE, 

这 个 定理 的 直观 意 浆 如 下 ,假设 施行 儿 mp AR AX, 
而 且 对 m<#， 施 行 机 ,= 变换 时 被 保留 的 段 ,在 施行 机 ,pr" 变 换 
时 仍然 被 保留 , 郊 么 (10) 表 明 ， 由 XX 变换 成 X" 可 以 分 两 步 得 到 .第 
一 步 ， 将 X 对 应 于 Ucr, HRR, 将 对 应 于 【J CBT, Tr) 
fy Be ORO SEE IB E H JES a WREATH ASA EX ,在 这 一 过 程 
i REET UBS THES BR TREL PE, Ih) Zo ASG AREAL, Tp 

th", Sloe, wee LL) oer BERR, Ke 应 于 


LJ CBT" ,zr O ADEE PRG See I ec I EOE BS RENT NA, ED 


ing 


到 X"， 结 论 (i 开 ) 表 明 ; 将 X 对 应 EA U UEB ti t Ba 
保留 ， 而 将 其 余 诸 自 抛 弃 ， 并 将 保留 的 段 按 原 次 序 向 左 平 移 不 相 
交 联 结 而 得 前 遂 数 下 是 。 存 这 一 平移 过 程 中 ， MERE, XX 也 是 
AERA. BRE CUD ZEA, MARREK, 

二 、 下 为 过 程 的 情形 | 

wwe UX =a{et), to}, 二 Pccothine1 ey 
EX. PRX AX HY aR ER, WAX = limx", QBS ILE — Be 有 

CoM) to(@), 


lima"(? a) =ali,o), Wo Wt<e(o), } CI 

根据 定义 ， 显 然 有 
定理 2 eX, ANG 2’, imX*= X, 则 对 一 珊 ? FOR, t20, 
Ja pE Pit), (15) 


其 中 {Pi (th, [Piy(t)} 分 别 为 "和 X 的 转移 概率 ， | 
MS EXCL, Bot, SP AEX HY AN HEP (Bo <0 
>0， 并 在 (6u<z 上 有 
Ba +T aTi, 二 (16> 


s * 


RPA ERHET. Br.. BCIE, URB.: =0, Wet. = 
Biko, AAEM 
Tasi SPa TB Tis Bair = Bi tO Ba, C17) 
称 这 样 的 偶 {z， 8} 为 标准 侦 ， 
回忆 甸 矩 阵 用 了 眼 的 过 程 上 类 入 .及 了 性 过 程 类 和 np。 
定理 3 HX 2, P(t, EEE FRE Co). CO), 
(a> Pli+aér, SrA Eeto) (18) 
P(t +08, =B 3At ELBo,T1)} =1, 
(6) SR 2.5) 确定 的 a 有 
P{z{ta) = co} 0, ih (19) 
N F B2Ri6 RZ 
O 条件 5o 成 立 的 一 个 充分 条 件 是 下 面 的 条 性 (c) 成 立 。 
Bil | 
(c) P{x(t)CEM—¥It E(B, T,)}= 1, ) (20) 
P{x(B,})= co} a0, 
(ii) MÆ, (ORE, WX Wa OEZ. 
(111) Mæ a), Colmar, M X =W, a OES 
EE HXCS,, Hatin, KEP SUE 
SPE Cac), WME 


P{a(infpt) =co}=0, ° (21) 
Be XS JL Be ERK 
A" (@) = U tito), Th41(@))*ACo), (22) 


则 CI) XWo ge (XD C2, HAM C10), Hohi rin, 
Bye"(m<cn, k= 039 为 
rr=L{A NEO, TE}, BIM=L{ANLO, BP}. (23) 
(ii) A*(n=1) 的 强 极 限 存 在 ， | 


limx*=X , | (24) 
其 中 X= {r(e}, t o} ERa olo) =L{A(@)}, @,(@) BH RE 
« p73 0 


L{C,(A(@) MLO, w}=t, } (25) 
的 只 一 解 ， 


$4. 定理 3. 1 的 证 明 


EIT, BARAN =i), toe. + 


A= | JES, tard, B= Ulta, B). (1) 

上 其 一 中 在 一品 
YOU) =L ANEO, w}, pO = L{BNCLO, wi}, ue, 
(2) 


BRA l 
引 理 1 (I) ye) + p(y =u, 
(ii) ra), pCa) R FREEDA. 
(iii) MRucdA, ucli<a, Myajcy(s), 
Ruck, wxli<e, Mometi), 
Civ) WUC Ees Tari), Sete) =e(8,) =4,, 
WRC ct, Bd, Wye) = YT = Oke 
(V) HECO, C= LIAS yo), (2.5) 中 的 o 是 方程 
rat 1, (3) 
EA, 
的 瞧 一 解 。 
引 理 2 当 w<0 时 ， 下 列 条 人 忻 彼 此 等 价 ， 
(i) tus 
(ii) yu) >?; 
di) pH-t, 
证 由 下 理 1 CO AAS GDM CUD SH. 
Hau, HSB 1(v) Hac A,y(a,) =F, ys] BB 1(iii)， 
YE Dyle) = t, Re, Bese, HSH 1 ti, yO SY) = 
tf. ROARS REBT CIDA 等 价 。 证 毕 。 


ezide 


引 理 3 Bmax AiR it. PIRIT, Bh. PHA YY 
x “~~” wits, HAERERE. Be 
ACA’ Ca¥ BOB’), (4) 
WX=W, s (X), X =W,’ aX). W 
(i) 可 人/ 且 对 1 EL[0，5) 有 Gi SAn 


GD 4 ` 
T=L{A NEO, Ta)}, B=L{A NTO, Bd}, (5) 
MT, BEX’ HIB, WE 
X= “4 (XY). C6) 


$ HMR. MXR RW 时 出 施 
行 变换 WW,,.s RRS, MX=W, a (X) 可 以 分 两 步 抛弃 而 
得 到 ， 首先， 对 义 施 以 变换 WW .，,*:， 即 拢 弃 和 对 应 于 号 的 绒 ， 保 
留 对 应 于 4 7 的 自 并 向 在 移动 腾 纳 而 得 和/。 在 这 一 移动 过 程 中 ， 


po BÆR Th, B RANN WERAWERA 对 应 于 
B=, BO BR, RESETA- DC, Ta) BRG. 
a4 _ Ano 


Fi} Zee eR a TH EX 
证 由 (4) HO=LIA)SL(A’) = Of, Hae, Hale 
ge Ub (ili) (OME EACAT GEA! M= MANCO, a )}< 
LA’ NEO, @)}<L{A’ NCO, æi}= t, FE, thai < 
BRT, BBX HIB. BWI IK = X= fry bc 
出 


A — Be) = SMA NEB ot) 


=u {arn (Urs. i %) 证. 
H G), =L {Ur Bests) =ou MIT O-O, W EX=X ， 


e225 + 


尚 需 证 明 当 t CL, Tps 1) = [ono ) ETC) =I), Ep 
zB, + to) =l + t— 0,). (7) 
Aus B,tt~o,(<a’), 为 证 (73, Aue HA A,+¢-o,= 


c ERR, AS)PA 1 ity), BSAA 


LIA NEO, Bt t-o)}=B,4+4- oy, 
AB, + f-o,C A’, 


(8) 


BAO too, TOn ETa Pas BOB +t-o, GLB, 
Tir JCACA’, HY, 
LHA (C0, 8,+¢#-7,)} 
=A NEO, B} +AA? 门 L8 Batt ~on)} 
= B.+L{[By Bt t~o,)} =B ttot tO 
得 证 (38>, BEB. 
引 理 4 BRAN = (20h), tco) AEE. 1 Ke, 


A= LF LCS, Thatts (9) 
imi A-O 
Wu) = LANCO, W}, C,¢A), CCA) CICA) 出 (3.1)-(3.3) 
ME. 
(D 定理 3.1 结 论 (i) R. 


Gi) CAYCATCC ATCTCIIA) STL, 0D, 0 
CC I{A}=L{C,(A)}=L{ Ci(A)}= o, 
(11> 


(iii) (a) ¥C@)ZEL0, 0 EPE; 
(6) Mla, 6)NC,(A)=¢, WIEC, b), 4 va 
= Y(a), 
(c) 如 果 uE CICA), Hucsco, MylWw<ryis). 18 
bly (ie) HC CAD h Pe 
| (d 对 变换 Y 有 YL[0，o) =[0，0), o=L(A), 
(e) ?作为 Ci(4) 到 [0，o) =Y[Cji(4)] 上 的 变换 是 一 
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N—-W, AMANE, Ayer le ewe 特别 ， 划 时 
[A, MEZAJ, FELYOAD, vO), Di 


YEGA At POA). | | (12) 
Civ) Yynoopt, PERM | 

a= L(A) tg=L(A), (13) 

etd=y (tf), FELO OD). (14) ， 


证 由 引 理 3 的 结论 (ii) AAS BAC. (10) AHR. B 
ey (AAR, HCA), A, CCA RSME, A 
而 得 证 《11) 前 面 两 个 等 导 。 

Ay Eae Gii (ea) (0) 《ed 明显 . WHE (iiiy (e), Ë 
FUER MEE C A), tesco, WAYO, WE CCA), 
USI, FPE ECCA), Eji, MAn FA Au 
so, H Gli) o ERTE, YSYRY), Edi) 
(¢), 

往 证 Ciiy Cd)。 由 Ciiiy te)，7 作 为 Ci(4) 到 YC(Ci (4D) 上 
的 变换 是 一 对 一 的 ， 因 而 Y :存在 。 为 证 保 测 性 ， 令 多 为 满足 FE 
CO ARLY} =L{F} 的 勒 岁 格 可 测 集 F 全 体 。 令 多 ={[a， 
bia, DCCA}, DUZER, TEIA, MHC, J 
而 多 和 包含 Ci(4) 中 一 切 Borel 集 ， 网 Jamakaar2, 引 理 1.1]。 玉 此 多 
包含 Ci(4) 中 一 切 惑 风格 可 测 集 ， 

由 引 理 3 结论 (i BaD (14) 中 极限 存在 ， 对 FEro， T), 
当 n 充分 大 时 ，1 DO， )。 由 引 理 1 Bit C), 


L{A*NTO, a) =t, | (15) 
ar CA", 

HA'CACC, (A), Snooff ie ia = limes 满足 
Yla) =L{AN LO, 0)}=+, | (16) 


注意 (10) aD 得 % 荐 方程 43.13)7 的 解 。 由 本 引 理 的 《iii) (2), 
CAA — iR Y N EER, hey aY CCA) >= [0， 


tial 4 


o), LICH AY} L(K AD} = 0, TE. 
定理 3.1 的 证 明 , 
aX AY AGE SEE C13) (14) 得 (3.11) (3.12), Aids] 理 
4 得 证 定理 3.1 的 结论 (和 (ii 。 往 证 定理 3.1 的 络 论 《ii)。 设 
FELO o), Hs} +t。 由 引 理 4 Git) Ce) Ce), v's), BEARER 
ye, Hy (3.13) 4 | 
E{C, (A) NCO, YTD} =s, ) 
YOD ECICA), 
令 s $ tiu E (3.13), MA u= YT C. By os O Ga 
于 是 
lim x (s) = Ema(e,} = limety” Es) = wy TLE) = elon) 


34: z 4i 


= x (i), DE, 


$5. 一 些 引 理 


WX={2(t), cose Z, WREX ABA 域 ， 
FARRAR, $ | 
Ti) =EB +E), t<op=o-8B, (D> 
BX, 2 (0,0), tcopRwidx’ Asaewe, Wei) 或 简 记 
FIA fae), WTP Res = (8<o) 上 的 完备 波 雷 尔 R. 
FLF G 
ER, WrePAXWATSEIN, MWA 


,NB FDF G (2) 
副 理 1 EXX SH, W 
Os FP EARNAN Fe (3) 
.证 设 4E 交 ?。 由 manaf2， 引 理 1.5]， 存 在 EO, t] 
REY = Bx EK BX voces ria thy GE ey OR ST A 
A={fa(t,), rit), see JE), (4) 


故 由 Isrmxaa[4， 第 122 页 了 
92280 


The + 


{~p 1 4«.—- T 


G,A= (fest), t2Ct dyer TET} EIA, (5) 
moF Oia), EJERE. MO, i = (8), 
ie RP (8TH se 要 证 (x (5) = TE Fg (ssi IEE}, BY 
Ria auo, str, 
{1B +3 =i, Bt titulolt #3, 
Hugt, Acro SB. dams 


> Bsti a-a, an 


~H<pct 《下 一) 


由 〈6.6.1》，P{z(8 +s) = co 了 =0。 由 X 的 右 连续 性 以 及 (8+E< 
HCB, + EEH), 
{[z(8 +s) =i, A+ricuca} 
= (ime, +s) =i, Bu- t, uo EF WEP 


31 理 2 ter, RRXW BA, WE TEX. SR. 
证 (@,;t<u} = Y teru} NB=1) 
= UOT) NBS) = Gr TE), 
由 TAUER, BEREA, Gatu Er, 从 而 Corte 
pEr? 
引 理 3 Hir, BEXAR, Meo LEXE H. 对 指 
E, v l 
=B = Otk = Tuts Bno Br = Bir Br RSL (6) 
iit’, EX DRIEN. 
证 Em8, Ti BEXM SA, Rt. BÆRER, H5] 
HRZ, 
(Oa TLELI O EPB TF, + ) 


O, BLEZO ) ELIHUBIC Fas, (7) 


依 定理 6.6.3, Tari =B tO TIA B ..=8,+0s .8 是 天 的 马 时 ， 


由 =| 理 2 5) Ti = Tari Bn = Oe Tis Bi = Bari — Bam Oa pi 是 
Kit. 
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Bi + Ogi Ty = Barı Ba + Os es 
= Barı + Ge Ti 一 及 = 有 ~ By = T; 
FEAT MESH (S. IRJ {T, BYRE BMT, B) X Bop 
m. 


引 理 4 ie it, AEX AER HEB, Mik (2.2) (2.3) WE 的 
ANG, 4 34 F n 和 .加 es 可 测 。 
证 要 证 对 任意 w 宇 0，1 守 0 有 
(o,<u, LELDE., 
(Ou, BEELER’, 
实际 上 ， 设 R 为 [0，co》 中 有 理 数 集 ， 


Guns LELO) = {DB <b, Lto) 
. . h-i . 


= L | (Tz + Beles Tati, <i<o), 


(co ALELO =f SB te Bto] 


ian É 
= J (Be — Tacha, Belt) LELT n 
rack | l 
X Ppt 


ff, SO, 311.4.2), ERBSC we, TEM, 


引 理 5 BT, BEXAR. ODE. IHE K E 
EEJ S0, att XMS, 


证 Aisa, RRR >t, Wal Ha, 
C0) = |] (BLUT acu) 


+ (Eu muL) 
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=|) (A, uct, plu)<u-t, wo) 
i - J 
+ Juche, yu) >t, ue) 
= J (O .<u-—t, Bay KUO) (ULT) 


+ ot, truco) (KP), 


RI, ERREF, WE. , 
引 还 6 Hr, AXA. Qi 按 {(2.5) 确定 。 如 果 定 理 
3.3 中 条 件 人 cc) 满足 ， 则 定理 3.3 中 条 件 (p) 有 成 立 。 更 精确 些 ， 


Pizti) EE 对 一 切 1 CA} = 1 (8) 
ErbA (4.1). SRA | 
Plx(a,)CEM—WtELO, D}=1, (9) 
P{x(B,) = OMAK = 0, (10) 


WR eS. SPRO (2) 满足 ， 则 对 几乎 一 项 E81 = e 
D Buch te), Ty. Coole 
+ (6,7, )(@) =T ,(@), 
u+(6,8,)(@) = Brt O, (11) 
证 (o 先 假设 P{Bn =0} = 1。 
Ay A, = {TH) EEN— MELA, Ti DNS, | 
(3.17) RA, =O, KHER WA, = 8 ,本 ,。 由 定理 3.3 人 条件 (2》 凡 
TIG TE 


PLA, } = PGs, A,}= > P(r) = R}P{A, | (0) 
点 福王 


=k} = DS P{2(B,) =k} =P{Q, }, (12) 


het 
IIUI HE P{A,} =P{(Qs,}. 得 证 (8)， 
全 Ant {8+ Ota = 055. —- Bue CLB,, tee The, 
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PEA A= 82 Ao. AEBS. SAFECO) (ec》 及 强 马 氏 性 ， 仿 
(12) 可 证 P(A4)=P(8s,)。 得 证 (11) 的 第 一 式 。 第 二 式 类 似 证 
A. 

(=) ASPB, =O}<1, 

IER 35 BB ph eX’ = Xi, . SHO, (2, BEX’ By 标 
EB Ep ` | 

Ta =B =0, Ti =7,-8,,83 =8,-B8,, toi, (13) 

出 于 定理 3,3 的 条 件 (a》 COOMAA(T, BEE, Am Ax AHE, 
Bf } 也 满足 。 按 5 一 )， 本 引 理 的 结论 允 瑟 "和 和 17 ，8 1 成立。 而 由 
(13), . 

{2 (E) CER— Yt CA’) = {x(1) CEM—Y ECA}, Ri = 
Q gye EOT = Ty Yeh, M11) BAR w+ G7, = 
Ti 对 一 切 &ET8， 如 ri:)。 因 此 本 引 理 的 绪论 HTX A T, Bh 成 
立 ， 证 毕 。 

SIE? Bett, BEX HER, P{8,=O}= 1。 和 定理 38.3 中 
的 条 件 (a)、(c) 满足 。 刚 对 任意 固定 的 st 0， 有 


Miti =, + Oe, (@), (15) 
证 令 X =X! 。 由 引 理 2， 
Be = 0,， ri=0a 7), Bi= 0a Bi, (15) 


eX AS, FD ey eA eX’ We Ee’. ASR RA eae. 
AlP{8.=0}=1, Sle, =@. (a), 


由 引 理 10V)，wE4= (ITB, ted. 为 明确 计 ， 设 
. k- 


CE (Bis Tarija HIIG, @, 400.0, =Thery MtO Bi = Bos 
HES), TiTi Os Bi = Bay, — 0,. $5 | AE- BT 
得 


Ti =Trip— By, Bi = Braz rg, a C16) 


由 引 理 IT CV), a =b, (a) EA = | JIB, Tiad. 为 
"Eak. i 


e 232a 


ie 


明确 计 '， tre; CB: Tisai de f#¢ 16) RDB ey — Se COI Tae 
一 Uss AA Bay t,t Oe CGT eas Hj Ear Ëa (a) GCA, 


其 次 ， 由 引 理 15Y)， 、 


f= LIA’ NTO, ai)}=L{ C33 ri D NEO, z>] 


i-o 
= L| (J Banm ts tur @ 9100, Ba,C) | 
[=ð , 


= LÍ U (Beer TaD NEG, matea D) | 
iIa 
=L{Af[a,, @ +6. Dh  - 
O Am HANCCO, @4+6, (a) IF=L{ANL0,0,)} +4 = 5+ 8, 

于 是 2,40. (0) 是 方程 | 

Y(tw) =st+ ‘| 

HEA, , 
的 解 ， M Cease by Ss ER. BRE 14) FAL, LEA, 


$6. 强 极限 定理 的 证 明 


定理 3,3 的 证 明 ， 

(—-) HEPR = 0 = 1 

Bta dee arbol shes, CB S| BB5.5AI5.1 以 
Bm (6.2), 


n—1 
Aina [lie Hi} ile DER, 
中 := " 
As= {ri EF a, 。 
Hy 5] 7 ee RIE, 
Pir 1) = Tass ELEPO, = i kan} 


e Z3 o 


=Piaa = iaf Aas T, LT yee, ) =i} 


= Pixlr, 十 中。 Ca, chi t= ina [aCe a = he} 
=Plaa, 2.) = tees /500) =i}, 


EB (3.19), BEX =W.., COMFKBEE, 
(=) (RRP {A =0}L 
考虑 X =X, DBR 65.6) n= 0 BAX HRB 
(T, AO 和 对 应 和 的 0 。 划 (5.13) 成 立 ， 并 且 
ai =m- Bs, ile’ (ai) =2(%), © D 
由 定理 3.8 的 条 件 C9) COXA r, BARRE, Mairt X7 和 
(T, P) BRE. FERC), WL. (XO 具有 齐 次 马 氏 性 ， 
AW, (X= W(X’), BREW. (X) 具 有 齐 次 马 氏 性 。 
(=) AXE Z FUNC 和 。 由 引 理 6 知 定 理 3.3 的 条 件 (c) 
ASAE), FFA AEBS. SRR Citi), we, 
定理 3,4 的 证 明 . 
除了 证 理 3.4 中 到 是 过 程 沿 需 证 明 外 ， 其 余 绸 论 都 从 定理 3.1 
和 3.3 推 出 ， 
往 证 P{ E(t) = co} = OCF 0), 
由 引 理 6， 对 几乎 一 切 6，x(+，@)》 EE 对 一 茹 EA, M 
而 | | 
a(t, EE, M-YtCAo), : (2) 
Wo SRB 4.4(iiiy(te)， 当 FEylC (A(@))] 时 ， P(e 
C,[A(o)ICA(@) Al), E(t,@) =2(y (1) o) EE, 因此 如 
BLAS o= {ilz @=HGCH), we 
yiC,(A(@))IC{t BC+, @) CE} = | Sm) 


FEE 


c J Sito US..(@)=[L0, FUO). 


H3. Gi), F(@) =L{yLC,(AC@)) 1}, WL Slo} =0, 
由 Fubini 定 再 ， 知 存在 L 零 集 T 使 当 CET BY, P{E(t) =co} =0, 
eo 234 a 


FAC 3.223, BG 4 inffi =e, W 21) RE PLECO) = oo} = 0, 


AR ET, BA t > 0. ALT) =0， 孝 可 选 u<t<t, ff 
fao- $, FET, 注意 对 每 个 0E0， 在 F lime(¢) = imete) 


=<(@.), GMARRDCE, 4D=H-D, w 
P(E) € D} = P{limz(a?,) € D} 


= limP{x(@',) € D} 


WA’ = Xir, ai= MHC), BETR X’ 的 强 马 氏 性 ， 
PAY ED}=P{r’ (ai ED} 
=P{x’/[a; +0. (a), JE D} 


ELPA at [2 (at,..)€ DI} 
=E{P unele) € DY 
PRPC.) CD}= mE {P ea Eriet EE HT}, 


因 t{ET， 对 几乎 一 切 @， elm, OCE, 故 # 充 分 大 时 zf(ei ye) = 
oa, a), 因而 l 
P{Z(t,) € D} = E{limP,,, ,[e(ai,.)€ DI} 


= E{P,.. ,le(@.,_.)€ DI} 


= > P{x(a,) =&}P,{2(e,,_.) CB} 


REE 
2D + Big 
Pít) =co} = DS P{xla,) =k} Pi {ele,,_,) =00} 
acd 
= > P{x(a;) =k} -0=0, 
AEE 


BERR P{2(t) = co} = Pri) = oo} = O(t SO), 
HFI 5.3 Mf, {FOs i, TRS nwo BHR URS 
{EFG isk<l), MAR A RE XY ARBE 
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性 ， HEA, 


8$7， 几 种 特殊 的 强 极限 定理 


定理 1 XC Hp. BE--BE, HAA X WS, 
WEP E cag., + 
Ti =inf{i B EtA, a(t) =, 
B =inf{tj r Etc Si, 
Tae, = inf{?|(Bst<o, x(t) =i}, 
约定 inffé=oc, $ HZ, M R=W.,,.K)CH 0, HA X AR 
$i, 
证 Bat, AOE, JAE. CHROME. B 
XE Mp, HCO) WYRE. SAE. 3H TG | 
定理 2 XE Fo, ER FEMANE AAR. + 
8, =inf{tiosi<o, wt) EN}, 
t,=inf{t!§,<i<¢, x(t) cM}, 
_ B =inf{t|t,<t<e, z(t) EN}, 
Tas, uinf(t|B,.<t<o, 2¢t) <M}, 
WX =W, AXE ao, FARAH CE-M, 
证 RWI, 
TRIES XE 2s, BABY, + EL + 
Bo =inf{f|omi<o, x(t) ED,}, 
T=int{tilB to r(f)ED,}, 
Bi =inf{t risica, ret) ED,), 
Ti, = int{? |Blai<o, zt) ED,}, 
WX '<Wye (HERBIE, BRPSHMAD,, 而且 
lim X" = X, (1) 
证 5 HE34 BAe", O} AXA, HAO XA 
{c", Oo}, IS. SPH (a) (ce) WIE, MAPO = 00} =0, 
Hrinf,35 =0, Mi¢3.21) tac, AID, +, HODR, 
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Bo 


PE Bc(t)eD,, WE fEA"= | JTB, Theis | 
上 -站 
(2) 


a(tyED,, WA EB, =| Jiri, As). 


HELA 得 X* HW (KIC Sn, th X WER, X 在 
Co POURRA ERA, MX BRS, 


往 证 {t|e(t)E BE} =Aa JA’, (3) 


BerChy=ick, WR n RIE D,, FR eC eED,, BO) FE 
ATCA, Atle) EECA, W(2), REABRAW Kin 
(3), £0, OFA ABLE Se= {tlelt} =}, MA 
yu) =L{A NCE, #)}=L{LO, o) NCO, #)} =e, 
也 以 ai =y (f= t, B=ao， 从 而 (3.14} 成 为 (1)， 
定理 4 BACH MERU, AFD, tE., 令 向 = 0， 
TIRAR SBT KK, 
B=int{t jr iata, «(f)CD,}, | 
TAKER By 8 — “> QR. 
t= Wes (XE 2. (—- Mt AR), (3.10) Bee, FAD 
仍 成 立 。 
ME 仿 定 理 3 引 用 定理 3.4, 我 们 只 需 说 明 现 在 的 情形 下 ,3) 
仍 成 立即 可 。 为 此 注意 
=(P) EE, MRicaA’, } 
e ED” WEEE, 
FERSIERD a 
注 ERA BAAR AA 的 变换 正 是 由 变 换 ， 定 理 4 正 是 借据 
撤 5[2J 中 的 基本 第 果 ， 即 伐 、 剖 L1J 中 的 第 一 构造 定理 。 


(4) 


(5) 


IT 


第 九 章 ”飞跃 区 间 和 流入 分 解 


§1. 引 Š 


AHS RM AAA AIRE. PTT SHE KR AB U K ER 
Ma, HHRT CARAS RRMA S MRA, RATERS 
程 组 成 立 的 用 飞跃 区 间 表 达 的 亮 要 条 件 。 我 们 发 现 ， 用 飞 吗 区间 
. 来 研究 过 程 的 流入 是 有 效 的 。 特别 ， 我 们 得 到 过 程 的 流入 分 解 定 
BA. 利用 此 分 解 ， 对 各 种 流入 都 出 现 的 和 情况， 我们 可 以 对 各 别 的 
流入 单独 研究 。 利 用 飞 既 区 尚 的 结果 ， 我 们 得 到 过 程 的 两 类 强 极 
限定 理 ， 即 变换 wg,，w 记 以 及 对 应 于 它们 的 强 极 限定 理 。 作为 这 
些 定 理 的 简单 推论 ， 就 是 供 振 插 [23 中 的 基本 结果 即使 振 插 等 [1] 
中 的 第 一 构造 定理 ， 以 及 王 样 坤 [3J 中 的 定理 5.3，。 


$2.， 飞 区 区 间 的 定义 


HXN={eth), to} EPn HEG.. ID, TRAE, $ 

其 我 们 将 假定 ， 对 每 个 4 ER， 
zlr, @) EE, M—-HrERNLO, ea), (1) 

这 里 以 及 今后 了 表示 [0，%) 中 有 理 数 的 集合 。 

EXI 称 1 EC0，0(@)) 为 XC(@) 的 连续 点 ， 如 果 
limz{s, @=xlt, 0)EE, Be ARIA Glo), Da) 
=00, o(@)]—G(e@)X(o) REE. 

回忆 定 疼 6.8,1，X(@) ABER RRIGA Tie), KES Rid 
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AM), HE 0ETIa) (rte), (eR {= 0 六 X(tw) HASH 
KRABET CRM. XC) 有 第 一 个 间断 后 Yit@) 0， 以 及 第 
一 全 KER IRE (@) =t, (a) 0。 
BR, MRe(ia)<coHo(@ET(@), Me(e(@)~-0, EH 
( 非 保 守 状 态 集 )。 易 见 Do) 和 Fo) 是 闭 党 ， 
对 每 个 sE CO, of), Wwe 
Hia) = max{Die) fo, s]}, 
v.(@) = min{D(@) NCs,¢(@) 1}, 


4,(@) =maxiP(@) £0, s]}, D 
n,(@) =min{P(@) (Ls, eoh, 
对 s= 0， 定 义 | 
VaL) ET (O), Ho(@>=T(@}, Bal) =0,A,(@) =0, 
(2) 


Ms 0, 4H. (@), (a), v.(o), alo) 为 3 前 的 景 后 一 个 
间断 点 ，s 前 的 最 后 一 个 飞跃 点 ，5 (RSA, s 后 的 
BARERA. E 3 汪 0。 WE 5sED(6) scree), MERE 
20) =n (ay = sA nla, ARED sera), 
MARCO) AsV O) A ELO, 

W2 FDO, 2) AX w HARRERAREN RE. me 
A, nE), HOA, Ar =e ZR). AOU REAA 
Hr), 

RAB, yopi RERE, PREA “on” A 
BRE. 

FY PEL I, FE RRS. 2.4, WOA, U RE, A, 
RS BE A SE BPA at, ME. | 

z€t, @)CE, MMe, 2), (3) 

定义 3 HDA, MCH(@),MCELNCH, 如果 z(%,@) CM, 
PRA, Ara U EA, WE ri-o MEN, WA, mM WUE 
B. BHP RUE My Uni, UR WSS, ip Xio) Bal RA 
SitA ne (@), REEF), (8@) 等 ， 其 音义 明确 . 
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HHeE6.7.2, XHA Urak, RAS, WAX 有 
Usk], CBE Us, 
HERI, 3.2.31], WEBRSS Roo, HILE —H 
DEUDA 
MO) <p (Oo) <tcv(@)<n(@), (4) 
从 而 易 若 对 几乎 一 切 2 E99， 
MOCO DO), Wo-UrERALO, ea), (5) 
{CA BY), 4-(@2)|rERNCO, ¢(a))}= 7z), (6) 
FEY (oO) A FIR, 


joe te) = {CA mila, MEZIO), Aetio}, (7) 
Eur o), yia, 其 意义 明确 。 记 
Ca = |) [A, D, (8) 
CA mee wt) 
Ci@= U am, (9) 


CA ae ato} 


类 但 记号 aCu(o)，CIr(o) 等 等 ， 其 意义 是 角 确 的 。 


8$35， 飞 跃 点 和 飞跃 区 间 


定义 1 Helo), Btw X@) HEME CRA, WH 
存在 s>0 HG, t+HONT@=¢ SHARE RRAN 
I‘(o), Rs MAMI CRAB), 


MMOH, & 
ra = {t t ET), a(t, o EM}, (1) 
ri (@) (E RERE ETit Et, tth. 
| (2) 
RHR OA LO MAM. BW, + 
rito ={t|t Era), c(¢-0, 0) EM}, (3) 
BRAM 
Pa (@) = (it FERR Erei ft}, (4) 
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BROCrHONI (a), MRo(a)<oo, Mote) cr (a), 
定理 1 对 几乎 一 切 2 EB， 
ria) = {n A, pEr Uh (5) 
F(a) ={A] EA, D Ezta) {om) |o(a)<oo}, 
(6) 
证 Ritts), GPRS OWB, BH tero) +H 
tyc(o), ft MATE eo fh G, t+eopnr(e@)=%, BER 
réct, tt+te) NR, TSAM TIO), (2.8) HEH # 
BR, EE. 
ER 对 儿 乎 一 切 ®， 


rio) =T"+ io) =p" (a, | (7) 


tT iaceo, Bicer, Er ORt=o(e), . 
BREE a), WE ICO, caprea), 4 
取 严 烙 下 降 的 nt t, REROCO, of@)), E n WENA 
fh (<r, HEET (oa), MECA <n, PREF 
Pir tars (oO) FER PRR. Gr dt it, Aloy, MERL, 
ria Ew), 于 是 tera), BRIT (Co) a), 类 似 证 
HIE (@) =r lo) 证 毕 ， 

定理 3 Mp LAR — Woe 2, 

Sems CoD U ATACE), xh 0) CE} 


Zea) {8) 
T0, gia) C toasto cro, (9) 
LIC, (@)}=L{C,(@}} =c(a), (19) 


其 中 | 
Sulto) = {E| ECO, ela), wet, @) CM}, 
MCF, (11) 
证 《8) 中 包含 关系 明显 。8S。koe)CT(o) 也 明 置 。 设 
FESeto)， 则 必 存 在 fiEE， 使 + 属于 X@ WATE Ca, b) 
中 。 任 取 r€[54, BAR, W FECA, b) cC, C), 4,(@)). Iek) 
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或 省 TCO), M@)CC (a), RH =A COE (ea), 
(fi, @=1CH, Ak Selo ce, fm U{AIAEI* (a), «ta, a) 
CE), KESHE. 得 证 (8 }， 从 而 得 证 (9. BI Lo, o) 
=S$2(@)US.(@), BL{S.(@}}=0. C8) 《9) 得 (190)， 证 毕 ， 

系 LI{T(®@)}= 0. | 

证 A (@) C0, o(@))—-C, (a), #010) 得 工人 Co = 0, 

& Ao) =S;(0)~F(e)=(0, d(a))-F(o); (12) 
YAM) ERA DAREMA, | 

定理 4 对 上 几乎 一 切 6 E98， 

Lm) j= (a), C13 

证 设 A, MEZA], KEX A, pm Aw. Bik 
12), A, MNT@)=¢6, WHER EA, D Halt, oF, 
CA, MELo, poAo ALA, 1) 的 最 大 性 ， CA, 4) 
=TA (a), (a) Eya), 

Bik, MEY). WEL O, PNTE) =p, ER (2.3) 
AA, MEAW), WRAT DLA), HO’ 7) Ao), 
M 和 /A 人 对 任意 sca’, a’) 有 sero), 因而 对 
ERICO, 0), FAO, Pano), HA, Er), g 
MABNaACO), Ne), RFF, A =A=), A’ = 4 =,(O), 
FELA, MAKE, Minh, mervlAta)l, WEE, 

定理 5 MCE, NCH, 五 为 非 保 守 状 态 集 ， 则 下 列 请 上 集 都 
EF inm H, 

F, ={0] y(n RAUR, GU v B} 

P,={o/¥(@)=%7x(ey}, : 

F = {ozo PARR —-PURA, 除 最 后 一 个 外 ， AO 
H H se X Pal BEE U wR ANY, 

F= {ofr o Sny loh, 

F= {oly ig Ts 区 间 ， 如 果 有 ， 它 是 最 后 一 
人 ; 

= {0|7 to) F EAA le Kil, m LA Us ER 
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是 最 后 一 个 UU 区间}. 
证 BAR, Niro, KCE, 
{x(t -O)=k}E #®, (14) 
次 证 
{2(A,) = 万] eC st, (15) 
实际 上 ， 当 起 o0 时 ， 由 2.1), 
{wh = kK) = {xth,) =k, A,<or} 


Tat, Ml nto) »aaMlE 78, 


{2(\,) = co} = (r<o)— (Ja) =k} eC #?, 
k. E 


TÆ 
F, = fl ir<e, Yeo, on, OENIE 8, 
F, = [ \{oxr) Ureo, TON — OO EN EFL, 
F, = [esn UEF, nao UCr<oe, MT, 
ré 
Ti CF ENDS EC #8, 
F,= REGSE Utr<in) 1 aare, x(a.) €M)} 
Ese, 
F= U tr <o, zn ~ 0) EH}E #8, 
F,=O-F,€ #3, | 
证 毕 。 


$4. tkR MARAE 


EM E, Nc E, SCE, $ 


Sus=inf{t'rxt<¢, ADEM, (ES, (15 
Psy = supi tl ogia, «(HE S, tim — 0) ENY, (2) 
ds=ini{t |excti<co, ET, wf) ES}, (3) 


这 里 r 是 XX HRI RRA, TEERAA, erah, info 
=O, suphH=0, . 
引 理 1 HSA ABR, MWC). (3) 中 的 inf 可 用 min Re, 
证 HEt Gius, THO, Thm) CM, aae, ASA, 
HXW SEE, 
Eye) = lima( RES, 


Rir ATEEN Kialla, DP, MrH R, ¢.€[a, b), 
Be Ems) EEC), Ace Shen PHA HT An) ECM, 得 证 
(D PRA minnginf, HANIA, E, 
引 理 2 
Eus = Inf{ Ey; | ES} = inf{E.>|k CM} 


=inf{f | kEM, IES), 《和 
PsN = sup{ ps; |Í EN} =sup{ow|KES} 
=sup{pa,[kKES, JON}, (3) 
ds = inf{d, [ke S}. (6) 
证 + 
Ays={t|t<t<o, TANEM, z(t) ES}, (7) 


BM Aum; Aus ECS), BR Su,2éws (FES), 男 一 方面 ， 对 和 任意 
e>0, FEC Ays = | } Aust t<Ems + &, tt FETE jes 使 tE 
pes 


Aus, Mitéuj;st<Euste, iius = infi En IES} Hee 
秋明， 证 毕 ， 

SIRES Eus, Osc X MBN, Ponte POLS, 
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证 ”由 引 理 2， 只 需 对 EEB，jE EB 证 明 &%y，6, 是 马 时 ，p;j 是 随机 
变量 即 可 . 
Shp bk, TERR 〈3.15》， 对 任意 如 320， 
(各 < = {rar<o, rh) =k, 
ree 
Tir) =f, Roo} ee 
其 次 ， 


CHR = |[- J rir) = 7) 


AU U (x fe , Zr) pI ET PRR HE 


a-i17- 


[or rama jers, 


C>) = LJ toso<a, n(n) =k, eq- 0) =F} 


TE, 
定义 1 XC Hs, RXARAMRA, WR Pilz =wY '"} 
=1ClGCE),; XHAN, MRP = BN} =1CE);, FAR 
MEH BIN, WBP,(O,)=10iCE), KE 
Sf, = (FF,.— FyUF, 
= {o| 多 (ao) 中 没有 最 后 一 个 U EBA, H. 
CD =y U {Dlg to 中 有 最 后 一 个 U 区 fal, 
除 最 后 一 个 U Kio, 其 余 均 是 Uw KAJ 
F., F,, 卫校 定 理 3,5 确 是 ， 
定理 4 HXC Ls, WPARKRIEST. 
(i) RLREX SEA COREA, BP {rT =..7°} =1CGeB), 
GD Piées<o}=0 GEE), Er 按 (4.1) 确定 。 
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Gil) 过 程 苹 满足 向 前 方程 组 。 
(iv) Si Ri>o, Piirci<o, r(AD CE} =0 GEE), 
如 果 上 面 结论 之 一 成 立 ， 则 
(v) Pi{ése5T}=1 GEE., 晶 精 确 些 ， 对 任意 iEE,，P; HL 
HoE (to) TEE ite), 
证 显然 (i 过 (iv)。 MZ, 由 Gv) HEMP eA.) GC EX— 
BreRitt, 0)}=0 (EE)。 由 此 并 注意 (2.6) 得 
P;{p2 =y )=0CiEE)， 此 即 条 性 (i}， 
(i)=(iii), wi>o, APiiatt)=co} =0, BOP; 几乎 一 切 
BC (Ci<o), fESs(@), ASERHS.3, ECC., PRE ZEDA.D 
Ex (@) Rica, a). WELA, M00, te), DR AR 
Ja— THRE C@OCTia), Bi, WAG), A, Dm BUR 
fj, r(A) = oo, MC (A, a), AMASA EA, ma ET, 
依 定 理 6.8.3， 天 满足 应 前 方程 组 。 l 
(ii 一 《ii)》。 依 定理 6.8,3， 若 结论 (iii) 成 立 ， 
Mpc, =1 EEE), 这 几 
Q, = {@| 对 一 切 rERN DO, ow)), zU, EE, 
wi ET). 
WET (&,<0)¢i, JEE), 则 xxz sys 如) =i, WFEÆErERf 


[0,0(0) Bhs co rE A — PER ADE, Mit Be CO) = Ay, eaa (O) 
ET(o)。 因此 oE2,, BM iz<o)CO-2,,. 于 是 由 引 理 2， 
(Epg<0)= |J ENR- An .得 证 结论 (i)， 


r.gadk 
(i) >i), Mec (y's x"), WEE. URLA, me 
z'o) AMEE EEn lo cow). FR 
(Y $O U (set<o) = (Esr <0), 得 证 绪论 {让 ， 
(DD =(yv), Aad, AP, JL-F—Wo, Thl = {ob} =, 
而 且 由 定理 3,2， 如 果 T(@) <olo), MRA OBEURAWE 
© 246 。 


Woe, Iknfr(t(@), @}=co, TO Er); 或 者 存在 严格 下 降 
ATAnLT(O), Anke U RERE Yna. Báo (1), rn, @) = co 
因此 t@critte), He, 

定理 5 XESS, 则 下 列 第 论 彼此 等 价 ， 

G) 过 程 半 满足 向 后 方程 组 ，。 

《ii 过 程 所 流出 到 co。 
| Gid Po 多 (oa 中 至 多 有 一 个 Us 区 间 ， 如 果 在 ， 它 是 最 后 
一 个 U 区 间 } =1，(iEB). 

(iv) Pi{r, Erw), t,<0}=0, GEH), Hit, 为 第 一 个 
BUR KA. HAERTER. 

Cv) SHER SOP fi<o, Xm ~ 0 EH, wo} =0(iE E), 

证 (ii 与 (iii》 古 同一 意思 . 

(ij li}, Hew 6.8.3, Pit.) =1, KB 8, = (| 对 一 
WreER 0, o(a@)), vic@)CT(o)}, 由 定理 6.7.2，P;(8,s)= 
1. ZBL, ={al/A—-WMrEeRNL0, o(@)>, Mr, — 0, 0) CH 
Fn (O}<o(@y, Melim, o=}, HES, 1 2,CF,. Sik, 
Roch NR., MEX(@)A—+ Use lA, n), Beon o, ©) 
EH, RAE ERNO, of@)) 使 n(a)=v,(@)=7,(@), WË 
nacoo), HoE Anw) =v, to) E T), WoE, n= 
RW (@OEC(O), FA. TEET) =0), BLA, DARA 
A UR Ma. ES, N RCF, MATRA diiy, 

Gi = (v) HE. hiie Gv RIRS AIE ReCO). 

(v= (i), Háky 得 P{2,}5310CE), RE 2, = {al 
HEÆErERNCO, o€O)), WER zn -0, @CH, WHE o) 
= o{@)}, 

国定 1 宇 0， 因 Pi{x(1) = co:=0。 由 定理 3.3， 对 Pi 几乎 一 茹 
ME CEO) NR,, t<Se@)CC,(o), Bite A, ner (eo) 使 
tela, n), MAc(y-0, =o, MA Act<viad<y, Ait 
ViC@ETCO), Bilie(y-0, OCH, WEOL, BAR vico) 
CT(o), WAV =A, WARrECRMLO, eai a= vila) = 
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Vii@=1(@), Woe, a= oclo), XIE Vio) =o(@) CT), 
HEA 所 Te)。 由 定理 6.8.3， 瑟 满 电 疝 后 方程 组 , 证 毕 ， 
由 定 秆 4 和 5 立 邯 得 到 下 面 的 两 个 定理 。 

定理 6 XC 2s, INP WMC. 

(i) XERE a a a a 

(iD XS coe A, WH Bleo, : 
Gli} Pif€ee<co}=0 GCE), Pr ETT <o} =0cie Hw), 
div) P;{fg =")}=1，By{ 多 中 至 多 有 一 个 U5 民间， 如果 
它 起 最 后 一 个 UU 区 间 }=1，(iEE). 

【TY Pireta, (ADEE) =0(t >00, iC E), 

Pii<o, e(n -0 EH, p<0}=-00 20, ICE), 
定理 7 XC 4s, WTAE i. 

O XBR RA Be, 
Cli} FFFEICE, ke HEP {ġera} 9, 

Palt ET, tieg} D0, 

(Gii FFI, kEEWER (Y= pp >, Piy pA Us RA, 
恒 不 是 最 后 一 个 UU 区间 } 守 0. 

Civ) FE: >O, tp 0, i, KER Pi {t<cty<o, wh JE 
E}>>0, Pitco, Xin, ~ 0 ENH, moot, 

定理 8 PX 2s, MCE, WEAH EREE H. 

《i SASSI MELA, BPP =e} = GEE), 

(li) Pi{fae<o}=0 GEE, M= E-M), 

GD HERO, Pilt<t<o, sh) E M}=0GEB),. 
RS OR, HEESE, t>0, WP JLR—Wec(t<ct<o), 有 
sla), @]EM, 

WE bnew, M 

Gv) Py{Eyve=t}=1 GEE), BW, 对 任意 ICE, X 
Pi 几乎 一 切 @€(1<0), to) ETE (a), 

证 《i)7 全 (iii)。 仿 定理 4 中 证 明 其 中 的 (与 《iv 等 价 一 样 
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(>i), HoE (E55 之 0) = (] (Erce). METE Hee 
A E 

CE, Wim LOW, Mir: (>, M DEVO), 而 且 
Hi alae (@), oE MEURA, ROE 4607"), | 

Gi =), AXAR REREH EdD, M-Mrce, 
Pifg CEis<a)y= 0，9 为 推移 算 子 。 令 Qu = (2-0, (Er) 
MP2 }=1, 4Hecl wt, X—WMrelo, oc(@d), Æ [maxcr, 
TiO), COPPA, UEA, Amro, eont UE Ae 
JE ag U BK [A] BIL, OCH" = ye ), 

设 结论 人 一 (iii) ZR, WIP ILP—le, ro) 
-{O BSH, Hii roe rlo, HMM 3.2，r(ao) Era) 
=P"(ay=Ty"(@), ER, 


($5. ui 变换 及 其 强 极限 定理 


BX = (elt), to} EN,，MC EE， 有益 集 D.1E. $ 


mfg = 0, . 1 

uti XH RR 

MBR = min{t uti ELX ADEM, X(1)ED,}, | (1) 
uty ABAR RRR. | 


hiet BRR Ae ERRA., Bg E.L, 01) 中 的 min 基 大 在 的 ， 
只 襄 其 后 的 集合 不 是 空 靠 ， 否 则 取 量 消 值 为 5。 

Hy SHH 4.3, wth, spk XM, BRP n, {ats 
eB EX A, FO SERS. SSR RR ER Cad. (Cc), Ai ik 
E8. 3.3, «k= Wye", wt XE 2p, BRE wX"C2’1, W 
„KEME, | 

EX 按 上 面 方式 特 ACL. BAKO CH’, HAR Wyt", 
uB", RURA uE. M =E, I FON Ia 
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这 样 ， 
MX" = MGA). (2) 
显然 ， 当 n+ co 时 ， 


wAt= (|iBs, ut asi dtu, 1 
_ re (3) 
MA, = UJ Bis MTR twA. | 
h=0 


定理 1 对 几乎 一 切 6E8 有 
wa) = us" Ce), (4) 
Cind ao) l= Ciuil] yC3 Co), C8) 


E Hep ywAy=vA,—(0, T), yA = yA- [0， T); T Fy tA“ KER 


点 。 YCA), C, CARRE 8.3.1 MA, uY), uO MEM 
2.322(2.8) 理解 


证 “首先 注意 ， 根 据 定义 ， 对 任意 ;EuwB"= Liat BD), 
必定 有 


a(b ED, Rr) ED cad EM, (6) 
- HETTE Ey", Bey 
tA DEM, (7) 


#HEC), MAT ESG. 

(--) 设 A, MEY UA Mm] BO, PEKA), 而 
wAi(@) AEE =h, WANE) =d, BERGA), A 
Ches WYDA, 2, MRA, MA ERSE, A), ra, o) 
CE, RifenfFas, @CD,, Mhh APEC, T CyAj(@) 
Tpl), BH(6) C7), <A, Marta, EM, Hn ms 
1. HH C6), sE ub a), s€yA%o), PAPE lS sE ubila), 
mt1.i(@)), A huria 这 样 G, 1) C Bilo), 
Thala CALO), GD, m 是 kw4Io) 的 成 构 区 间 冲 突 ， 
JHA H+, REAP GED =., Ais, nee), 
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Se ERB, n) Eur lo, 

C=) RA, Meme w, MAiri), 4, nEri), (4,4) 
NT(m} = 6, r, OEM, 

任 取 sE n), WA =A =m, Eris, o) EE, WEENIE 
T, QCD, Brh, SrA, @}CM, H) (7) 得 3EwA,, 
BC TEER > fis C Lubio), wti..(0)), Al AEMT F 
ÆG, ZBIO), fhal ODOTA O), SAY CE RHE, (A, 7) 
mA ta), 

Hi. MARCA’, nO OLA, n), BOA’, W)CyAC@), 可 
EREE, n). A, Ero), WA =h, non, B-BE, H 
O74, MO CyAL(@) Biv Alo) F(a) 36, BAKA, Wn, F 
是 和 =A, noon. BULA’, nO CA, >. BEG, nO ASREATE. 

ie keh, FLA, PEZA w), TE, 

HE yind (Oo) =v (ORB WT. PN, WAXES], 
M sA{@)=[0, o(@)), Re #[eA'(@)]=[tle@), o(@)), 但 
EY CO) = {hn Ane REL 2, oo} AX CO) BN KARR 

由 于 (3)， 依 定理 8.3,1 和 8.3.4， 


mA" = wo ADC 2, CB) 

Mia MA D = aA, ESCH (9) 
Fl asX "ity RRR FÉ, 而 且 就 是 x 六 € Fao BH 

lim, "= yX EP, (10) 
其 中 X ={auy C), Lya}, moa L{yA}, (11) 
MYA RESH uT, mB} (n1) E Pee, Ep 

MYC = Lin ANEO, w)}, wElo, o). (12) 


由 定理 i 及 引 理 8.4.4 绪 论 (ii)， 
MYU) = L{C EnA] AC} = L(yC, @d 00,0) Y, 
| (13) 
MO= Lit [yAC@y =L yO, ca}, (14) 
H38. A.d BSR SLO, ORRIA) = Cho) 
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E. KR, RMB Te R. 

定理 2 HX, M(i9—1d Mt, MArseRÁA MH 
入 的 过 程 ， 如 果 X 满 足 千 后 方程 组 ， 则 X",wX 者 满足 向 后 方程 组 ， 
RSX SAR HOmE. 

E wX HRM BAM PIO R AU 区 问 的 段 全 
MRM, TMM BS, 并 将 保留 的 段 按 原 次 序 向 左下 移 不 
相交 联结 而 得 过 程 nXE 名 。。 

证 AX VR. RRP UR i [0，T(@)) 和 甸 ， 其 
KBE, Baek 纯 自 对 六 入 。 引 用 定理 4.5(6iii) 便 得 本 定 
理 中 关于 方程 组 的 结论 。 南 于 天 ， 五 ，， ARARA — TCE a 
tio), HEOR AIA. EE., 

Rl 设 XE2,， 并 且 P{y2 "=2'}=1， 

则 lmyX"=XX. £15) 


证 ”这 是 很 显然 的 ， 因 为 在 系 I 的 假设 下 ，xwX = 工 。 


M2 EXE P 
则 limxX* =X, (16) 
其 中 X'=g (OEF, (17) 
X™=g,(X"), mon, (18) 
如 果 XX 满 足 癌 后 方程 组 ， 则 关 " 也 满足 向 后 方程 组 ， 且 关 与 XX" 有 相 
RO. 


系 2 正 是 定理 8,7,4， 即 侯 据 括 [1] 的 基本 结果 ， 即 第 一 构造 
定理 ， 


§6.， 过 程 的 流入 分 解 


定理 1 XEF., BAHEMCE WME 
Plait) eM\|r<o¢}=1, (1) 
Here. WKE, MXE pri. HA 
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AMHA, (1) RY, Anixe- Bi. 

证 因 z 纯 自 必 流入 时 ，XX 的 一 切 D0 区 阅 《 除 第 一 个 外 )》 都 是 
URE, HC, TCT gt, 

设 *<o。 由 定理 3.2，zETcCT gt, MRE IT, Wet) eM, 
Pr UN FEE PRS PEA, C TuE Tr, Hrn EM, H XRRR 
+E RIM HY STE, bee rir) = lime.) CM, HEERST) cM. 
得 证 上 17》。、 _ | 

HD 受 式 的 强 马 开 性 可 得 式 的 第 一 ， 第 二 ， 第 三 … 个 飞腾 
AD, 7, Tè, IPER co, Merr EM, WELO), 
Xeo ECO tI AWS RRR, WAE 1 SRR 
MB RYE. BMA ST, 存在 iE MEX (CO) ELIDA BRYA, 
AmA, PI PAIS PRI. eC. La. TE 
XX 在 [0,t](t<g) P RRA SET CEM. MAXXE, TE 


H, 
EM WXC#,, WHERICE, > 
iX = {GYTE t<o}, | (2) 
WHC FRC2. 3, Ie 
= L{i;C Hr) = LGC, 100,49}, (3) 


VY EYADE, ERO, CBRE SCTE. BRA, 

Gi) WHCE, XC #& a RRA. RAH EM 
程 组 ， 则 ;也 满足 向 后 方程 组 ， 并 且 X CATH ORR, 

Gi) .及 E22 是 纯 自 避 流 入 的 过 程 ,满足 向 前 方程 组 ， XX 与 
XHM. | | 

证 在 定理 5.2 中 令 M= {由 GCE), HREM, HAS 
理 4.4 和 定理 4.5 即 可 。 

注 定理 2 的 直观 意义 见 定理 5.2 注 。 


87. Mis 变 挤 及 其 强 极 限定 理 


设 XE 2TH CK, MCE, ARBRE, S 
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wb = 0， | 

HT1 为 区 的 第 一 个 飞 睦 点 ， 

wnBi=min{t Pitco, t Er elt) ED, NM}, 1) 

uti, Auf ADEA KE. J 

易 证 wi ， wi 是 下 的 蕊 时 ， 对 每 个 5,{w?"，wB*} 是 X 的 标准 
人 个， 并且 定理 8 ,3.3 的 条 件 (a)(c) 满足 ， 因 耐 依 定理 8.,3.3，wX” 
三 Ww pp。 实际 上 ww 人 "E21 是 一 阶 过 程 ， 

定义 1 按 上 面 方 式 将 XE 2, 变 成 w 卫 "的 变换 Ww ,w7", 我们 
9 wl ARR. GM =E, fidel Af. 

REX" = wf (X), (2) 
显然 ， 当 n+ce 时 ， 


对 好 "一 UScwB5， uT iw, 
h.-0 | (3) 


MAY = oki rut tidy 


仿照 定理 5.1 可 证 得 
定理 1 WLP Wece, | 
YLx4i(o)]= puyria), (4) 
CixAm)1=C LA i (@)7=yCita), (5) 
其 中 yA7= uå- (0T), yA y A-(0,7), BYR C 量 仍 按 定义 
8.3,1， 定 义 2.3 及 (2.8) 理解 。 
由 于 (3)， 依 定理 8.3.1 和 8.3.4， 
MX" = whe X) 2 ,, | o (6) 
Mala = 4X", MAM, ) (7) 
uu" 的 强 极限 过 程 存在 ， 由 44)(5)， 强 极限 过 程 就 是 定理 5， 2 中 的 
过 程 wxXXE Zen MEMA. 5(iii) 就 得 到 下 面 的 定理 。 
定理 2 XEL MODRE E 
lim 4X" = ur Cf, (R) 


如果 X 满 足 向 后 方程 组 ， TY an A XE a ABH, SPX, 
«e 254 >. 


MA's wR A AOR. 
Rl RIXE F, MRP =7'}=1, Il 
lim wX* = X, (9) 


E2 XC Z. o MWR =e) =1, MRA XTARA 
AA, M] 
jimw*= X, C10) 


i} mh oo 


HPX = F(X E 4, EX TE R EA, MX 也 满足 ， 且 
FAAM ERER. 

E 5XEEKIEH, R2EÆ EHCI, E5. 3H 4S 
= c 时 考虑 的 情形 - 
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第 十 章 ” 过 程 的 延 拓 


ot 


§ 1. 5l 


过 程 的 构造 问题 本 质 上 就 是 过 程 的 延 拓 问 题 。 如 果 最 小 这 
程 中 断 ， 构 造 一 切 Q 过 程 的 问题 ， 就 相当 于 构造 最 小 过 程 的 一 切 
延 拓 过 程 ， 并 使 延 拓 过 程 与 最 小 过 程 有 相同 的 & RR, 4O RT 
时，Doob[1] 最 早 引 进 最 小 过 程 的 延 操 ， 即 所 谓 杜 对 过 程 。 钟 开 
3e7E Chung. 1] PME BIRR ATE TRIE TE. ee 
[ij 以 及 Kunitaf1] MOR, SRNR LSA, 
Hey eth Soe BE, 

EEPROM J ot A HB ed. BA, 不 要 求 
ORS, TERTE “PU $, FE 8 2 中 我 们 甚 全 不 要 求 台 违 
HESE. 

我 们 主要 考 硅 非 帮 延 拓 。 由 于 DD 型 延 所 可 能 改变 过 各 oE 
隆 ， 因 此 我 们 引进 D* 型 延 拓 ， 以 保持 9 MRE, “AGA 以 
考虑 其 它 类 型 的 延 扣 。 例 如 ， 对 某 些 景 小 过 程 ， 可 以 引进 所 调 Y 
Wee, HB GIA A E= dra) tace), MER tco), 
X(@ FLO, PAAAAS AURK, WARB—+ Kap, 
其 佘 U 区 闻 部 是 -U 区 间 。 还 可 以 引进 DP 型 、VY 型 站 RAE, Æ 
章 中 我 们 只 作 简单 而 初步 的 讨论 ， 
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82. DEEM 


BPA) = (OG, ICE, t SO WRO.2.A—C), IB 


2 Bij HCE, (1) 
设 给 定 分 布 T= { CE} 
0< Del, (2) 


引 理 1 存在 概率 空间 (28,.f,P)， 在 其 上 可 以 定义 一 列 过 条 
X"={o(t}, t<o}(n>0), BRA AER, 
《 ke#, (n>, BAA MMR BRB PC, 
(ii){e"=0}U {or= co}Cfortt=g}'?, ned, 
(iii) P{at*1(0)=jflo<o"<oo} = t, 
P{ot*1=Olo<co*<cof=1- Yj, 
i 


(iv) FEROS <oo) mia" (=i 27, A" na) 
K™ (> 4) oh ite Y., BYE BE O Sty CEng Cre Ltn, fmi» Ings s 
Inin cE, A | 

Am = {IC tak) = Inn LES} (3), 
We Rll, now 
aad a a4 
e{ Maia Jr {Naaf a Ala}. (4) 
其 中 4= {o<o*<Coo} MBA = {eo =H}, 

GE ARCEMIS TT, PRE AE RS 
O, F, P), FER RAGE MT Xo ={2°(h), Eco}, 
Xt={2tG>, t<ol}, (#1, iC DWRRIATE MP RK 
Foo), ENA TAER —3°, 

1°, X’, Xt Ca, (nei, 1E EB), 目 转移 概率 都 是 PCi)， 


OAE, PRMD PS 1 Aa ee, AX 1) HERE 
Mm, Wii Pi{o<o*}al Gis). 
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2°. Piz") EE} =Pic’>oat, | 
Phei(Q}=i}=1, (41, 1¢F), 
PiP=it=m, GEE), Plfr= onl- Zam, 


8°, BX", Xi m>, iC BE), Finzo eww, 

ROL?) 为 集合 viloci<ccoo} Mate BR. Moc {f° =i, 
Cio?) =1}, GEE), &ax'Ct we) ori(t,@),i<oal(@) = on) 
Feola = 0。 对 于 @E {f =i, Clt) EE, Ar t,o) 
= x 0) soilo; BMA o=o. Me, 
我 们 得 到 一 列 过 程 Xe= {2"(t), FCm), 

BLE 2°(n=0) BRR), MERO 成 立 。 根 
TEX RA, thE A PEM CI), 

Ayo RRM EX, Xman, ic EB) Erona), hR 
3° ,对 j EE, 

Pei =j, oloo} P], 0< oc oo0)} 
=P{ f= f}P{o<o%<o0} = 2,P{0<o%<00}, 
此 即 性 质 Gii), 

为 证 性 质 (iy)， 暂 时 园 定 nn 及 jEE, & X°={xX1+1, Xt= 
Xi fos fmt Sw PPR, XtCme1, 1E), "n= 
Og xxXmS0) —R, WRX, XttmSi, iC Ef "Mm =20), 
RIP Case X= 2"), tco imS0), BRE mS ORK 
BTA (mon, ECDPM), HAMS 


Anim = can fname tin) = Frame L.Ay Lek Shyam 1 he 


_ n+l _ a n+! 
N= [|] 4, M= (lA, N= A Aas 
amil Ma. antti 


WY m, 
{x 0 =t} ON a {ric AN, 
P{N} = P{N|x*!(0) =}}, 
THAI’, 3°, FEGDRRMA={O<e"<cof AA (2160) 
EE}=å, Mit 
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P{MNA} = > P{MA, x cgh)=}, N} 
- PMA, f'=j,N} 
= Ptvaptrr- J}P{N} 
- D> P{MA}n;P{N{ e100) =f} 
= POMA) 之 PE (0) 


= {| A}P{N|2™!(0)=/} 
= P{MA}P{N'A}, 
由 此 知性 质 (iv) 对 有 = (0 之 00) 成 立 类 似 可 证 对 4= 
{2""' (0) =i} aa, BEB. 
定理 2 wee VARS LA eA) X= {zi1), 1 
<0") (n= DRAA r RUPEE Ci) —Civ), $ 


Te=0, 7 = a7, t= a, . (5) 
MoOst<o, + | 

zt =A, Aiea, (6) 
出 Gi) X={ett), ico cw. 

Gi 天 的 转移 概率 {1pir0t 1 由 下 式 给 出 ， 

Pit) = Bi) + [asc — s)dK;(s), | (7) 
其 中 C1) = Di mii Ct). (8) 
MAH MPN: 


0, AMES 
O U, mt>o, 
K; = S Li*L", Femi, 


n= 0 


nti 一 于 rn L, (9) 


by =f 


L(t) =1-~ 2 Pu), L= Dml is | 
| 
J 
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Clit) XAH Bi HY SESE SR HP 
EF =, (10) 


证 AX Ee, REHEARSE, MEE 
典范 过 程 ， 因 而 结论 G 成立 
说 4 和 和 二 1< T FET Jis Jas s ji EE, 


4 


& A= (l(t. =1), 


a=} . . 


i 
AMi, MH, A) = (aatas ta) = he, 


am] 


we <tc rt}, (12) 


PRPA > PACM, Mat MDS CE3) 


Pam Sea yy 
P MACH, os Me) = Ay, 
tem, am =m, WPA im, <i, my = 
Miri = Mh, 因而 
P{Atm,, «+, Mm41)} 
= PAs Lte ipa ta T") = jas 
ktligast +i} 
= D| "pte PE ai HEL a a e a +1|4,,77= 5, 
I0 = DAP A TEs wD) = i (14) 
HPA, MAREK sm-1), ASG, KARR 
BAST | | 
P{x(t,-s)=},, krima<l+1|/A,, t=s, 2(0) =i} 
=P{2™t,-s)=ja Kr isastt+i)/ 20) =i 
=P{2"(i,-s) jak +i<a<tl|2" (0) = pi (tui 
- fi) 
=P{a"(t,~s)=],, k+imeaxtl{A,, 77=8, 
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TO =i} Bris, ty 


RAO WHER oy a A, = iy, = MIN, 
P Ami, Tta hs. iD} = PLAS Ps ay Grint, 
Sim, =m<om,.=r, BIELV, 


PIAM, Mra) 


= DPA, 200) =i, z Pra ST) S jip feos 


“bay . ; 
= >| Plo" (fpi t= ja lAn T =5, 
i cr 


2(0)=i}d,P{A,, t<s, x'(0) =i}, 
由 引 理 1 性 质 (iv)， 被 积 表 达 式 等 于 


Cia) 


fay} 


(16) 


Plo'(ti.; 一 人 = jisi |2"(0) =i} = Pig, Sere ~ 8), | 


XA BEER ii) — Civ), 
P{A,, t'<s, x°(0)=1} 
=PiA,, Tas, 0<o' <0, 2°(0) =i} 
=PiA,, t<s,0<o"'"l<oojn,; 
如 果 能 够 证 明 ， 对 :党 ， 


(17) 


(18) 


PLA, <8, 0<of-!< cot = PLA} (CL; ,;eL'-""*! )(s— +t,) (199 


则 将 (15) 一 (19) 代 六 《137 中 得 
PT{4+1} = 之 P{A 


Teo a a l 


4 > ie 
-H jag 


1} {Peed rr ~ fd 


Ti bres — Sd, (L; YE TITLE 1) 


‘(s~4)} 


= > pi Ay} | 


Om alert y 


{Ir ' | 
+f tir 8); Cs— #1) ) 
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=P(ANDs a, 0b 1 一 #;}, 
EE RRE p tb]} 为 转移 概率 的 章 次 马 氏 过 程 。 
往 证 (19)， 即 要 让 
P{A ts + £,,0<o% 1 oo) 
=PLA}CL, »L?-™"1)(s) 90, (20) 


wr=m+1, LRA ST 
D P{A i, e otas + ti, (0) =i, 
v E Eaa tT) = FE tS 
D| P- jn As HAL, 
mah, 20) =tped.P{Ay 1, 
2"(O)=i, meu}, 
由 引 理 1(iv)。 被 积 表 达 式 等 于 
Plem(t,;-wj} =f), Sst fm) = 让 
= Piet, u) =) erco) = iLa 
代 回 不 来 的 式 子 并 道 转 刚 才 的 计算 得 (20) 左 方 等 于 P{A}Lyits)， 
即 (20) 对 + = m+ LiF A, 
用 归纳 法 证 (20)。 设 7 半 摧 十 1。(20) 左 方 等 于 
SPATT! +a 1s + t,,a°7'09) =i} 
= D| Pitos At au, 
i ry 


x ' (GO) =i} » P(A 0°"! <u, 2°" (0) =i} 
= D [Plots + tule 160) 
i | 
=i}d,P{Al, Tle, x°7'(0) =i}, 
但 是 P{o" tas +t ujio) =i} Liis +t t), 
XHG — vV ARAB, Huna 


PLA, tieua, r'o) = i) 
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= PLATT lu, Qo" toe a" (9) = 7} 
= P{A Tl <u, Oot? ori 
= PLA} CLD t ot a tym, 
因此 (20) 左 方 等 于 
att 
5f miTi(s + ti— WP{AA CL LLE t) 
pov 


= P{A,} f Ls 一 vyd (L (eto i-m-1 Ww) 
a 
= PLACE ebm! es), 
得 证 (20). 
在 (7}) 中 对 jE BSR ANGE 
Spul- Lilt) :| Sa {lL(t- sdR(s) 


=1- D+ Bra sds) 
oN i 


=I- +CD aKO- She LY) 


站 一 由 


=1-K,(@)(1~ Sr). 


HFC), BAA PER AO, BAA BAY FE BER AE CLO) 
ar, TE, 
注 1 ”由 于 定理 2 中 的 过 程 X= {z(t+, tc 只 的 前 面 一 部 分 是 中 
WPI REX’ ={2°Ct), tco, MARE: 
Piatti jiti eo}; (21) 
TH BEI Bae BACT. EE, PTT RA HA EAX’ 
x = {xj，jEE}D 型 延 拓 过 程 . 
注 2 在 (7) 中 耶 拉 氏 变 换 得 
> EB) 
BCA) = Bi CAD + orkh) 1 Sa . (22) 


s 76i» 


Sb VO ABODE PCO AMP CO WEEE, TE 
ZA =1-A DCA), (23) 
i 


§3. D 型 延 拓 


FE SP AR OF ee ay A oe OP 

在 型 延 拓 中 ， 如 果 立 ?的 @ 奸 阵 保守 ， 从 过 程 的 样本 轨道 知 ， 
X" 与 其 马 型 主 扼 过程 耻 有 相同 的 8 给 阵 。 但 如果 交 ?的 O EER 
T: WX SX RO 窜 阵 末 必 相同 为 了 保持 延 扣 过程 的 8 ERA 
AS, FUT S| UED* WEM, 

ENI PKS {eN LO} ec F MaeOAX@pMTB, AM 
Piceo), Hoo) Fe BEERA COLE 6.8.1), BPK o(@) 
为 卫 尾 ， 

是 然 ,如 果 过 程 X" = {x,t E22, 的 转移 概率 为 POO 
则 下 列 诸 量 

M; (i) = Pie (Gt) =], oo SPE}, 
N: (t) = Piri th S j o Are}, 


Mi= SM, Nt = SND, C1) 
RC =M;(0) — Mi (1) =P at, o° PH}, 
由 已 (区 唯一 决定 。 


3182.1. RIJE 


引 理 1 BPO WE (1.2.A—C), MRPICERI>O, 有 
Rif) >00, 分布 Tz 潢 足 (2.2)。 则 存在 概率 空间 (人 ， 久 ,了 ) 及 定义 
于 其 上 的 过 程 询 Xr= {0), P<} Heo RA PAE, 

GD ZE 和 sz0)， 且 有 相同 的 转移 丢 率 PC 归 ) 

Git) {o"=0} Ufot= 00} U {omy X" YT YC lot! = 0}, 

(aoe DO) 
(iii*) P{e*4(0)=7 |A} =x;, 
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P{o*1 =9 |A}=1- PE 
i 


其 中 和 = (0 过 0" 之 oo0 0" 是 区 "的 P 尾 )， 

Civ") ER<, o" 是 X* 的 P 尾 ) 或 {z+1(0) = 人 之 
E, man) GX mow) FR. 

定理 2 RES RS A LE KTS (arch), t 
cj (n= 0) By S| RE BE CA") Civ"), H.D (2, ODER 
={x(i),i<c}, | 
RM O XE#,, 8 5X ne OA A ORE, 

(ti) XPS RERP* CL) = (m;a FRA H 


pitt) SPD | DdD, D. 
Hra. SBE. KIRCA., ERRA P HL OA 
成 (1) 中 的 Ri(t)， 

(iii) 天 不 中 断 的 沈 要 条 忻 是 8 保守 并 且 (2.10) 威 立 。 

证 ” 仿 定 理 2,1 证 明 ， 但 最 后 一 结论 需 重 新 证 明 。 由 人 2} 得 
Sp) =1- {N0 NG} — fi- DEA 
} k 


+5 mN} KDE Sa Nalt -s)dKi(s), 
A 9 
| (3) 
WRO, BARN.) =0, WẸ (2.10) 成 立 ， 则 出 “(3)} 得 
D Pit) =1, 即 X 不 中 断 。 反之。 如 果 X 不 中 断 ， 则 必定 NG) 


-0 天 为 不 然 的 话 ， ARIEN = Pp GL, YX TRY > 
0。 依 引 理 1(ii)， 在 正 概率 集 〈f<a" :0 为 X MTR) E, c= 0° 
<c, REGAR PRPA HNG) =0 及 (3) 得 (2.10) = OMe, 


OnE, BAB dad- da,;>0, WA 
i 
Pi{0<o < 0, oO EXT R>, 
i 
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AIAN: Ci) >00, HOR AT BE, HEB, 
注 1 在 (2) 中 取 拉 大 变 换 得 
> HPs A) 


Pu OD = g nu OO + E OO 4+ ____—__, (4) 
P: 1— D tE) 
A 


BE Ch) ABAD S) EP CE) 和 P(t) 的 拉 氏 变换 ， 而 5:(%) 是 
(1) FO AIR Ct) RE RETH, 

注 2 SARE AX CH EEX’ EaD" WB 
延 扫 过程 。 过 程 和 "和 它 的 妃 * 型 延 拓 过 程 有 相 疝 ORR. WR 
天 "满足 加 后 方程 组 WA 

注 3 MOR, AMAT Æ, kD’ RREE D 型 延 招 一 
a. | 


$4. HWE 


EDHE P, WRX RP (OLE MAN R-pOnmk. A 

的 马 亭 流出 边界 B, 表 示 ，(3.1) 中 的 Ri(i) 成 为 
L(t) = Pilotai, z(o- 0)EB.}, (1) 

定理 3.2 便 成 为 

定理 1 BA CR POW. WETTRE D0, RCA 
EMILE) > 0, DAAE.. REX" CH (DAS OHELVE 
KARZ a EARS O 过 程 ， 具 有 引 理 3.1 PAHE ( 行 ") 一 
Civ*), WHO, DO. 9) YX € & (0), KBR RPO AF 
葡 给 出 ， 


POf + | a ~d), (2) 
hrs Erud), WER. OME, BAP WL 


PREC LOER. OX BP ERE ORR EH A210 eT. 
定义 1 BOND WERE BHO, AST. 
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MO.) EPIL TEX = {a(t) te}, 
Plx(t)=tle(t7-O) EB} =5,,i€ BF, . (3) 
Plo=t X(T- OEB}-1~ Sm, (4) 
Ferry KER. TEC A 
| Sy Hb) 
Bi) = & (4) + Eh) 
1- > HRCA } 


S Tas A) 

(1- 27) + > Tail- ECA) ` 

FES (Aa OPRL ORARE. A, ORF, 
Exh) =1-A DO), | (6) 


= hb; (A) +A) 


$ 5. 广义 D 型 延 拓 


Di GE RAMD WEARS BIL. ARTS eK 
MP ARE 
根据 有 限 的 O SMO, HBARHT, AIT BAO 
ARBSUWAB HWA ARABS, HAAR PRS. 
vd FOUL REX = {rlt), <rt PB, MARAP {ta} 
>0, Reo eH UB. > 0, HPG.. DAE, 
显然 ， 对 Borel 集 TCHI1JB,.， 下 面 庄 量 
LP, th=P,{x(r-0) Er, rt}, to, (1) 
h(E A) =E {e*t wt— 0)ET) 


= [eid LT, t), ASO. (2) 
心 


Ha OME — th Ge 
设 给 一 族人 分 布 I(a， (2E HI|] B.); 满 足 


a 2 


We, DSL, | Ha,E da) >0, (3) 
- Hk, 
引 理 1 HRA (Oo, F, P) REEERE hO 
FEA T= {a(t ICO E # (OHS), EAA PFE, 
Ci) {0"=0} {= cof c {ott =a}, 
. GD ERA" - O CHUB) ELER 
Piet lg} =f mo O}} Hito- 0), j), FOE, 
Plot! = wo 09} = 1-H ¢2"(0"°- 0), FE), 
(iii) 对 由 (2.3) 确 定 的 4， 


ati 


PL) Alero) =i} = PANA o =i} 
H+! 
{NN Aero =i}, GER IZ, 


Civ) 在 集合 Airo" CHUB} ELPA 
PP coro } = [Aae } 


rio- 0) \, 


P| Na 


一 二 


黄 中 由, 仍 如 (2.3)。 

HE {FURR HET, 不 难 证 明 ， PERAN, F, 
P), 在 其 上 可 以 定义 一 列 最 小 过 程 ?= {2 ), LOJE R., 
Xpa{ai(t), LERA, CE WRB E WEI 
Homa EHUB), CNAA PREM 

1° P{z'0Q)EE}=P{ri(0)=i}=1 

2° P{f'\(a)=i} =H(a,I CCE); 

Pi f*(ays coh} =1-H(e,E), 

38° WX’, Xime, cE, Fie, aCH UB OWA 

Wa 
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ROC {x (o°-OCHUB,, fix (or ~0)J=i1} GEE, + 
wecra)=xi(t,a) ,t<o' (oa) =0'(a) Gas o(a)=0.5 NX! 
= ty too} e # ER hOWR. Beto’ >0,， 可 确定 zlka+ 
- 0). Moec{et(o' -O CHUB, flet(o'-O =i GEE, = 
et) = t<co*(@)=cl(@); Gieo o=o., ait 
继续 ， 我 们 得 到 一 列 过 程 X"(n 宇 0). | 

仿照 引 理 2.1 的 证 月 ， 可 以 证 明 现 在 的 XX"E (8S OER 
过 程 且 具 有 本 引 理 的 性 质 (i) Civ) ,证 举 ， 

定理 2 REXER- MEZHER OREAK" = {x"(+) 
f< 和 多 30) 具有 引 理 1 PR te Mi div), $ (2.5) 
(2.6)5E MX ={a(t), <a}. Mi 


(i) 如 果 |， H(a,E)u(da) =0, 则 XE sg, 是 最 小 过 程 , HOR 


MSX ROHRER. 如 果 | Hla, Dulda) >00, WX C2 ,是 一 


Cll) AB FE LP Cf) FA FAA Ha 


Pilt) = fitt D [Fu -8 daO, (4) 
r 
mK RE FAE: 
THD = | Ha, f)Lj(de, t), 
hE 


1 
Tip (= | Ha, DY LTH) Ltda,* 14), | 
HUB, h | 

J 


K= DTO. 


ES i 


"ma, BH 
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[TROVET OND =| That =a, ds), (6) 
将 C4 ?变形 后 得 
Pi) = fis(t) + | (ma,t =K dads), 


HUA, 


l (7) 
H priat) = SHa, Dfe, (8) 
À 
LAUT OSL, tC GCL sa, (9) 
LLT, Df | Li (da d) > Hla, KLT, t-s), 
“nua, k 
(100 
ž 
Ki{T,s)= SLicr,s), ) (11) 
nl 


虽然 定理 2 的 证 明 可 以 仿 定 理 2,2 进 行 ， 只 不 过 书写 表 有 党 村 黑 
7. 但 因 $ 537 中 定理 的 证 明 与 定理 2 更 类 做 ， 然 而 我 们 却 把 证 
明 省 略 了 。 因 此 ， 我 们 在 这 里 仍 给 出 定理 2 的 简单 证 明 线 索 。 

证 只 需 证 明基 是 以 (4 ) 为 转移 概率 的 齐 次 马 氏 过 程 即 可 ， 
其 余 明 显 ， 

#2(2.11) (2.12) 86 AMAM, «mt, = As, (2.13) 
3. TFRRC2. 150A ue, ESLER IRIE PF, Sm = mi 时, 《2.15) 
仿 然 成 立 ， 

Ryo, Wik =m, M =r. 刚直 引 理 1 (iii)， 


了 fi p= Y P{A tT Sty, <r’ +9", 2"(0) =k, 
h 
a Fip T S iat 
lzy d 
= =| P{æ Cfi T S fal At =s, 
A T'i 
x'(0}=Aj;d,P{A,,t’ <s,2°(0) =A} 
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= =| nt faia ,Ctr —syd, PLA, r <38,2°(0) =}, 
k f} 


(12) 
ISR AG we E BR: Rss bay 


PA, T'<s,2°(0) = A} = TI-E- ty), C13) 
WAR Jel C12) 中 得 


f + 
Pia BPA) f T fia re OATS t) 
h i 


=P{A} 2 | st tps TI iro" iC), 


h 


(14) 
go. 15) (14) RAC. 13) EP LAr = PAP, E Éa 


一 1 ) ,这 里 piy(t) 由 (4 确定 . 因而 苹 是 齐 次 马 氏 过 程 . 


为 证 (13);， 即 要 证 
PLA), =s + Fj 2 0 = ky =P{A}T PRs), 8220, 


由 引 理 1(iv)， 上 式 左 方 等 于 


P{A,,a°"'! (07! ~0) Eda, x (0) = ,T's + tr} 


Aus 


E 


N¢a,A)P{A,, vitor — 0) eda, Ths + fi}, 


Hud, 


o C16) 
#245 ar=m+1, iil] 
P{A,,x"~'(07"1 -— 0) Eda, t's + t} 


= DS PLA, 20) i (tT) = Fy, TS TO, 
To 0) E da,t” + amst ty}, (17) 
由 引 理 1 Gil ， 上 式 被 加 项 等 于 
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P (Planch = u) =H, 2(0"= 0) Eda, 
ome + fou le) a ipd, P(A ,,2% 0) =i,r7<u} 
= [fis Cw) L; (da, Jd PKA ,,2"(0) = fei}, 
RE C17) 中 并 逆转 刚才 的 计算 得 (17) 左 方 等 于 PAIL, (da 


5), AMA GO A C13) SP rsm. BURR BA 
因 纳 法 可 得 18) Hiromi, EB, 
BGP, ATT, (OM RR, BCT ,A C2), WMA >, 


GijA)= SGLAIGHAA), 
P 
于 是 从 (4) 得 


isd) = OCA) DECR ) OO). (18) 
a 


当 @ 保 守 时 ， 上 式 妈 [1， 公 式 (10.3,25)]。 用 党 阵 符 号 ， 记 G(X) 
=G A), Mj GD) 成 为 


PA= GA) SG AIGA), (19) 
„w-i 
A KT, dys | eden), | (20) 
i 
ACI C10} 


hieT ,A} = Ay ,A), 


RICE, A= | nitda, A) > PCa, Rhs(T,N), 
l BR 


ng, 
(21) 
于 是 (7}) 成 为 
His (A) = $i) | [Brida | DB Ua PdA. 
Hua, "oi i 
(22) 
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如 果 令 


0,cePr, 
Vea, Po = | ne 
1,067, (23) 
Veca, PA) = > ita, BRAT, A), 
点 
出 有 V+ (a, TA) = | Vrea db AMV, D, A), (24) 
nay 
RiP, A) = | hitda, MOVATA). (25) 
naoa, 
于 是 (22) 成 为 


Big = O50) + | hi(da, A) | (S¥"(a,db,2) 


HUB, Hoe, "aD 
Xin (A) ). (26) 
Å 


HORT, WE A Kunital1, ARON] 
EXI PREM AP HAXWX EHHG, +), ac HUBA RDB 
延 拓 过 程 。 | 
WAR, SEMUPRX AX, HRS{(e(0°~O) CHUB} EJIL 
PH 
Pie(o*) = ro -0)} = Wale? + 0),)) ,jEE. 


$86. 广义 D 型 延 拓 


SOR TH, | MDM ROR, HOFER HR 
>. Fut, RAIE ADRE. 
假定 最 小 名 过程 的 洲 出 边界 B。 非 空 ， 即 4B.) 0, eat — He 


分 布 Hta， aE BMC, E <1, | MCa,B)Ada) 0, 


4 


4& I(a,E)=0,cEH, | (1) 


«273+ 


TE Shta E, AmaE AEA. oR. 

EMI RX TA BOW, MA RE CL) 的 4Hta,*)， 
GCA SBS MDMAA H(a,+), oC BSP ADRA 
过 程 . 

BA HORT, ADEE DER TE 
面 的 定理 是 明显 的 ， | 

WEL BLOM AX SHil(a, -), ce Bj} RD*H LH 
过 程 X 有 相同 的 OR. Pe. ABLE. MA 
{2(t- 0) CB} EJLER 

P{z(v) =jle(t-0)} = HI{r(T- 0) ,7}, (2) 


$7. 瞬 返 过 程 的 延 拓 


PER RB RR, BAS 85, $ 6 相仿 ， 旅 
AW. 

wX=a(c(t), t<ohCH, Ak PERIE HRB RRA 
Pii), TBR MAA. RF SOPH HUB, BRS 
UB, XE | 

WH + B+ ,Bt ene +a- Ben (1) 

在 ,HU BERME H. BEX PE, B iH U Bo 全 0， 任 给 
Akalla, "(a 万 日 Bi) 满足 


(a, E1, | MHE E) (da) >00, (2) 


iu kr 


引 更 1 存在 概率 空间 (如 ,.F ,Py)， 在 其 上 可 以 定义 一 列 过 程 
nn0)， 具 有 下 列 性 质 ， 
Gi) XR 宇 0) 有 放疗 的 转移 概率 Pi;(1)， 
Gii) (0"=0)U (oF = co) Col =0), 
(iii) FERMA{a(o"- 006, HU aBel EULER 
P{z igo =f ro m0)}= (a*(o"- 0), j), 
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P{o"*! = Q|a(o"~ 0)} =1~,HCx"(o*~ 0), E), 
(iv) 同 引 理 5,1(iii) 。 
(v) 将 引 理 5.10iv) 中 的 HU Beam. LBB 
定理 2 设 趾 义 在 同一 概率 空间 上 徇 过 程 列 和 RE 名 ,{n 主 0 上 
冰 引 理 { 中 的 性 质 人 划一 (Y)。 按 (2.5) ODEA X ={(24), t< 
S}. my 


G) 如 果 | o, Byuiday=0, WXE ws, XH X 的 k 
《ii 多 的 转移 概率 ;, Poy Ct) a PSH 


MESEN ARES EID [ars E= Sd aKus). (3) 
T 


RE atiPizti) = bis(t)+ | f a, t = 9K lda, ds), 


atv, 
(4) 
其 中 atla, E) = aa, bulih (5) 


MKi), Ki, ORG. 5). 0G, D -~《5.11) 确 定 ， 但 需 
作 如 下 修改， LT, t), Ha, +), H, Be, TIO), Ku, 
Li, E), KO, OmaT AMEk. I 
L, F) = Pato ET, otat), (6) 
roH U.B, 5 
相应 地 ,在 (5.18) 一 (5,26) 中 作 显 然 的 左下 角 潍 加 后 ,我 们 有 


PPOO SaPA) GAY WA), (7) 


hel] 


vA) = ap) + | { Datta, hy} Ba Dat, 


Am] f 
ALAP: 


(8) 


a 


gy Wy CA) = phe CA) + et (da, A) 


Pe - 


xf (> ca, db, wy) Sans, Lets). (9) 


vite. co 
定义 1 he Sz BBLS RFE XX ROL IE Ca, +3, SH ij Be} 
广义 D 型 延 折 过 程 。 
对 定义 1 中 的 XX 和 XX"， 在 集合 {3(0' -0)EkUsB 上 几乎 有 
Pi{x(o") =fi[a(o°-0)} =, (r(c°-0), j), (10) 
EG. XSxRDAM AMR, 当然 更 谈 不 上 有 相同 
的 Q@ 了 。 因 此 有 必要 引进 广义 D* 型 延 拓 过 程 
ERROR EX C2 Bel Bejl>o. AEA (a, 
(aE Bo FR Hia, F<], { diia, E)yutda)>9, 


a, . 


& 
ica, E)=0, a€,H, (11) 

TEF PARER ARIRE AmS AEA 

E? MKC Hy. MX MIM MAIDA Ela, 1), aCaH 
U Be MDI SE EXA AY Oia, +), 26,8, } ADW 
3E Fad 

定理 3 K 阶 卫 返 过 程 并 "Ex 与 其 (Ma, "3, GE, By A 
DN a eX a Re Bdk), RPA, AA 
ll ORR, XW E a Al. 


$8. FARRER 


从 现在 开始 我 科 转 铝 Y 型 延 折 ， 呈 型 延 折 属于 瞬 返 型 ， 过 程 
运动 到 无 穷 后 ， 它 从 无 穷 立 刻 返 回 到 有 限 状 态 。 当 然 ， 过 姓 也 可 
区 从 无 穷 * 慢 慢 地 ?返回 到 有 限 状 态 上 来 ， 这 就 是 V 型 延 拓 。 还 可 
以 有 DV 混合 型 延 拓 . 

Chung [2] 研究 马 氏 链 的 边界 理论 时 ， 对 过 程 的 样本 斩首 进 


FT MMA. SUTRA MARMARA, KATE 
RU HEP RM he RR RIA. 但 是 ， 
Chung 2] P24 Ha PEASE Ie Ak. DRL VA 
MIDVIR ACHE, PREARRIE ARE, MA KR E MRK 
AHERE FA REPL. BLAS RP KER RO SB a 
间 是 飞 牙 区 间 即 U 区 间 。 WEA SUE KE AD 
He ALE AE BG ea 

万 型 延 拓 过 程 在 每 个 飞 既 区 间 中 的 运动 ， 是 按照 从 省 限 状 态 
出 发 的 最 小 8 过程 前 运动 方式 进行 的 。 因而 描述 跳跃 情况 的 嵌入 
链 是 通常 的 离 获 参数 马 氏 链 (z,，m 基 0)， 它 有 开始 时 刘 和 集 中 在 
状态 空间 E 上 的 初始 分 布 。 介 是， 型 延 拓 过 程 在 每 个 飞跃 区 问 
中 ， 其 运动 是 按 从 无 穷 出 发 的 景 小 8 过 程 的 运动 方式 进行 的 ， 描 
PUB ELAR AGERE (n, -oocin<iico), 热 而 它 不 是 马 
民 链 ， 世 不 是 适 常 的 平稳 序列 ， 它 属于 由 Hunt 引进 的 逼近 马 氏 
链 。 因 此 ,通过 马 氏 链 正 是 我 们 构造 非 莫 返回 过 程 的 基石 。 但 是 ， 
有 逼近 马 氏 链 是 定义 在 测度 空间 上 的 ,此 空 疝 甚至 可 以 有 无 穷 测度 。 

从 现在 起 直至 本 章 床 ， 我 们 先 介 绍 逼 近 马 民 链 及 它 的 特征 测 
上 度 ， 进 而 研究 过 近 马 氏 链 的 发 生财 刻 和 中断 时 刻 与 特征 测度 的 关 
系 ， 然 后 以 逼近 马 氏 链 作 为 霸 入 链 ， 构 造 飞跃 区 间 中 的 样本 罗 
道 ， 即 我 们 煌 造 了 所 谓 遥 近 最 小 2 过 程 ， 从 而 可 以 描述 从 无 穷 出 
发 的 最 小 过程。 我 人 建立 了 流入 族 和 逼近 最 小 怠 HES BH 
应 。 最 后 ， BDO WR BERRA 
的 样本 就 道 ， 即 得 到 最 小 过 程 的 DY 型 延 拓 过 程 ， 并 求 出 了 此 类 @ 
过 程 的 转移 概率 的 解析 表达 式 ， 该 表达 式 是 通过 流入 族 表示 的 。 
ARIS. WADA eS Rha, BE 
广 闵 DY 型 延 拓 过 程 和 广义 LDV)* 型 延 拓 过 程 。 


$9. 随机 链 和 特征 测度 


pA PLEMA A A G.A, Huni R, ROAA $ 
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i. REE- WREKE, WEN = (Tj,i,j EE) 是 子 随机 矩阵 ， 
即 符 阵 开 非 负 且 行 和 不 超过 壹 。 当 子 随机 上 矩阵 的 行 和 为 过 时 ， 称 
为 随机 和 矩阵。 设 (a ,多 ,PP) 是 测度 空间 ， 好 2 是 非 空 的 抽象 点 集 ， 
和 是 吕 的 某 些 子 集 组 成 的 po 代数 ,P 是 . 守 上 的 测度 。 我 们 强调 指出 : 
RARER, F PBS RHYMES. Se, NERD 
的 集合 。 

EXI WHEL, FP) CET HBR a, P): 

(G) & 是 取 值 于 {-co} U N WFR Wes, SERET 
NU {+ co} RY PRY Hil oE, eSB) 

(ii) Hp oC LEM Bela) <n<s(@)RneNn, HE AE 
(H,@)CE, MAMAEN, tice, 

A@,D=(2(n) =1) = (a, 2(n,o} =i, EO) <n 6(@)) 
CF, | 
REFR, e B HE LE. 

Ot FER PLEC, e, A, BADEN, iE EN 
ofa, is (2,¢,8), RAC, e, DREE. So 
WAG Dns #, LEDER, iA. (2,¢,8), 

定义 2 设 trz,&,B) 是 准 随 机 链 。 邵 果 对 一 切 n CNAMICE, FH 
PLA GGI] + oo, Pire, B 7% ROLE. 


因为 =U U ADD， 因 此 ， 如 果 在 测度 空间 (C, F ,P) 


hE RT RIS, Mab Era EE. 

可 以 对 一 切 h eNge Nem, wo). MN, F#RAEE, OEE, A 
=f, Xfn<alo), EAr, o) =A, WPRO), EAr, 0) = 
0. ER RE 

(xim = A) = (nla), (ein) = 0) = (Bon) 
BF WW, EERTE, D, EINMELEDA 
限 。 

TEMS B (r,e, B) EILE. 如 果 已 知 链 的 * 现 在 ?的 条 性 

下 ， 它 的 :过 去 3 和 * 将 来 > 独立 ， 即 ， 对 任意 的 8，m，nEN,，k< 
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Merny, Wikin ， 仿 
ASAN iaj ATT ae i C,t;), "=H Asa 
HEPA) >I, RA 
PONAD POND) PONY 
PCAN) POA) POA) ” 
FR ATI BR Cx 2, By HE, 
定义 4 设 (z;ay 朋 是 马 氏 链 ， 如 果 对 尾 意 #zEN，iEGEB， 有 
P(s{(n}) =i, (n+ 1)=})= P(x) = DI; 4, 
PRs DANE, BENRA Bea AY (~~ 3 EE. 
EXS (ra, BEME, CHE MEO LM (AFL 一 ce 上 
NU {+o}. + 
Gi=(cEN, asch), Faw TF, PCA’) 
SPAD, AVEF’, | 
Woch, 4 
7(@) = B(@) ~o(@), y(n,@) =2(a(@) +n), 
MENER FP) ERENS, 我 们 称 随 机 时 刻 0 将 随机 
#2 (250, 8) 5) SPINE CY,0,99. 1h 
f.(x,@,8) = (9,0,9). 
定义 6 iire, P 是 随机 链 。 ARATE SRETNI {+ 
co MRE ALE) e. noel, EERE, LPDR ede, MAB 
He REAL BE Co, 8) S Se SES. (zx,&,8)， 则 称 GD A. 
BLM. 
定义 7 Bir, e ABLE. CARAT NUL + co} 的 多 可 
iil) oe Be, AUER CN, (CSME F,r, B, Wow ec, 
e ARTAR IRA RE SLISZY, BRR RE eI. 
定义 8 (r,a, AIBN. 如 果 ae D PORE, w 
A Cx, a, 8B) S| F BT BERS Be OL Bad Fc, EN ee By ER R 
Fp. MER (oc, ¢, 8) UN, 


iM =, G= Sm, W GaG. PRB OK E 


a= 
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中 的 状态 分 为 常 返 状态 和 非常 往 状 态 . i 为 I GRY ORR E 
Gia = + co l 


ENI n= CEH EL AWE Mocna +odEE. 
当 每 个 有 限时 。 PEAR; 4 之 n< okt, Mna AE 


BY. iwi, Ej 21 ysn ED, ramte wE., 


“ul = 1 时 ， 称 ?为 五 调和 测度 。 
定理 1 Eae Oe Se, SCOARE LASHES 
WWE, GUC C=1, CGD = OC] 47), 
n= > Clzin)]jdP = DP) = j). (1) 


gine coe 


Min = (1; FEDER. RANE, a, B) KREWE, 

证 设 (x,0,B) 是 囊 链 ， 初 始 分 布 为 ?， 则 (x,0,8) 确定 的 圣 
征 测 度 为 了 = vG， 当 然 是 了 过 份 测度 。 设 (za 有 是 通 近 链 ， 记 工 
ef, (2,¢, OM NEMA, WET ow, Bi n, E 
an, aTe, Wns Tih. UES. 

定理 2 g (2,¢,8) BN, CHEM RAR, 


心 g= BAB, B= —a, a’ (A= 2-H), 
WU sot BE Cae’ ,a ,8 1) 是 逼近 吕 链 ， 这 里 ， 当 人 一 0 时 ， 
| Os: 三 让， Ji (2) 


“n,=Ob, ON Wem, AB Os; Ei, 且 行 和 不 超过 登 
Bay, 
证 RDEEN ARTE, Apr be (ee e DRADE AA, BD 
_ [suplny GAGA, (ny) ED}, 
oo URE ma gE ZR. 
ke, tHE BEC’ ,0 BO BIDRA. El n(D)<o, WH 
(Daath EDERA AZAR, ANTSAL, 
HEE Ge DEU, Be=0, Miaa Ay. $ 4.3,12) 
PaL), W6.3.16) maz, BY 


(3) 
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PCe(T} = ip, 了 TY ” 了 一 


一 mh, SEC ts ty. 1 Mkisi taa PHT, stg }Dilty). 


(4) 
其 中 y= vG, 
COREN (zc, Dawe, SERRE, BE 
fa CEEB) = (2950, Bn). (5) 


Te (2,,0, 807 SDA MA A Ta REM HEAT. Mnn, 且 对 
LFE HoE aL RRR, A 
ALO) +7,(0} 5T), Eal Tal Sarla) j, BEIROD RT C Ens 
OBOL., Fm RRE Cee, DR. 

(4) HE ee as BY 

Pir tery sig, ere’ + ysi,ye ere? +h} Ht), 
= Ci, Eo Ci, JOC, 1, JOE, To) Qe tk) 

其 中 8 是 道 链 (z ge B O REDIRA ENI el B(x’, ea’, 
8 引导 到 9 链 。 到 D= D1 个 E 时 ,TCD,) tB, We (D) = 一 TCD,) 
je’, Wit, (r,a, P EOIS., ESC. 

定 建 3 Hir, e, DERI, 基 特 征 测度 17 有限 ， 令 eD) 
AH (2,62, D BRE eS FROM MA, RE 

aD 人 ss mm) EDH, (8) 
hs， 如 果 上 面前 集合 为 空 集 。 
Me<a(D), ~c<a(D), DERE, DIEA aD) le, 
i Ae D) (2,2, 6) 5 Aree 
F ain)€ 2,0, 8) = (20,0, 80), . (7) 

证 Fae BENSE eB RADR AT D), 
定理 2，T 用) <b’, TD) +t, HDE, FCDA’, Rib 
&e(D)y= 一 Y7 (D), Wese), =oD, DIEN Ael) 
pa, RE, eUD e DS SR, Ha. fee DRE, 
Jikel a AW A. IESE. 

注 ESR, SHE EHA A ERE MRE PE e, 
Bs A PER Eet, TS. (2,0, B EME. 1H e, 


a 了 是 了 


Be Ae, Ac, DEARER SRE. 
KR Ea, DEREI, ARE nag MR. UYE, 
Bah a RDA Zp ai, BN 


vo) =P(x(a(D)) =7), (8) 
其 中 eCD) 由 C6} 确定 。 则 Yop 的 支撑 集合 合 于 DD 中 ， 而 且 
voi = Lb)), (9) 


其 中 
= 了 Pi ED, yn) CDso<cn<e), Tt (v,0,d) 
Of, OFF (2) 确定 。 
证 ECA PRK -= OF 

Pelt) =)) = HCG Los), 
HE UH SA ie FA Pa Ce’ ,2 BR 

Pig (rt ) =7) =n Lod, 
H pr E ae B RADR A Meee DARPA], i 
XAT) =TatD))。 上 式 化 为 (97， 证 完 

定理 4 Rik SREDINE. 捐 定 的 有 穷 子 集 序列 D1 
E。 则 存在 测度 序列 v* 具 有 下 列 人 性质 

0) vA R, RARR STD 中， 

(ii) wWGen, AED, ESE; 

Gii) v"Giyn, nto, 

(iv) Bin<im, WWE Ww pA A TS ADA 击 中 
Ai. BP, $32, 0, HRN, MSHA v™, BIA Dh Al 
aD, #5 (2,0, DI BT GE (a, 0,8,)5 WC 08. IR 分 布 
AV", : 

(Vv) FEMEZZ, I PO RENTER L AIRE s,e, 
B)， 其 特征 测度 与 ?重合 ， On eC 8) Wh eB tivo, WA. 

ZIERA, WBA Kemeny 等 的 书 11,58 + 
$12j。 我 们 指出 ， 由 9) 知 ， 定 理 4 中 的 由 "1 和 了 接 下 式 确定 ， 

Wi) = nC Loi), (19) 
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S10. Miri A+ h kao p eat Al 


Bir, a, B) EWED, Beh ERRERA, A 为 链 的 中 断 
时 刻 。 EE, PEE MO. AUER, smin EN 有 定 S, 
(AREFELLA, 8). SHC AD=C,(0)=0, JEE, WEHI 
fe (7,¢,8) ie PE il Bas 

m= | EGP =| E Cian) dp, JEE 


pane 
(1) 
定理 1 Bire DEREI, RRENEAN, 
(i> WRB, WLAR BRB = + ccs 
Gi) 可 果 几 乎 必然 8 = 一 00， 则 7 是 了 调和 的 ， 
(iii》 设 和 有 限 ， 基 Riesz 分 解 为 

= NG, vaq— al, lim pr =n’, 


Mii EvA RM 和 
v,=PC—co<ta, 2(a@)=)), (3) 
位 势 测度 7!: 有 表现 ; 
ni = | S Caisin) dP, (4) 
Ca 
WWM En AER. | 
| X Cem Mp, (5) 


GOV) Bng E. Mrk 4 HERA LAP RR oca 为 
3A ay 24 BA LPD - oo =, 

ig BRIER, n=l, eS PR e= EN, as 
aED ERTE, 0, Ba) 

(i) BAAR, Alot, AGE, ARE 时 刻 几 
Bu RH too, All, Æ, E, JLB AB. =8-a,= + oo, Hp = 
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+o, FQ. 42, REO LILIES RB= + 09, 
(ii) BEIA 
m=] > Cila€k)1dP 


mee ae + 


ae = C; rt hy ]dP 


# —-t 
~ A A 


= lim f ~ Clrim)yidp 


a. „Ħa Tra 


= lim S Pean) =), 


THe iy g 


ve ni; = lim S Piron) =i)H;; 


op 


= hm > Pr =i, T+ 1}= 7 


O . nls. + a 


= lim >  €:fa,0m)1C;Ca,0m+ 1) dP 


nosy oe 


Q -MH 4 
Ay 


lim | SC, x(k) 1CjLa(k +1) dP 


Tee ag ato 
A 


| S Cifetay JC ca(k+1)]dP, 


a y 
人 


il 


MEE ERM 
Eata] > C; Ce(h+ 1)]dP 


“J 之 Crm) dP, (6) 


WR JL G Me = — co, ERER EFI, B m nE 。 


Cii) 如果 91 有限 ， 则 由 067) 得 
CNH yn Pio coda, rle) =i), 


a, 
--] 
Mar" 
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由 此 得 (8). 
RETO, RIA 


qm); -| > GErm)]dP 


ga btham<tes 


= | > C ,[a(m)j]dP 
ecu’ + Dsl T4e cs 


+ | > C [ecm jdP, (8) 
rt 
注意 1; = | > CjLa(m) dP 
cade gy? tress 
+ > Cetn)ldP< +o, 
corms (9) 
(8) 成 为 (nT), = ;~ { Sw Cem) dP 


-和 


[=m 


;= | > CletmyldP, I*+oo. 


fe xI M A 


结合 (9)， 我 们 得 (5)， 从 而 得 (4)， . 
GY) 当 几 乎 必然 ~- coat, HSA n? =0, JA a= 7 
FEU, RA, WHA MS, Watt lo, ROA SoM 


HF, MZ P-o sa, x(m)=i)=0, 对 iEE 求 和 得 几乎 必然 
mit 上 


~ OO<T ad, 

BUR LP PR - cose, 由 (4 有 ?91= 0, 因 而 n= 小 是 调和 的 ， 
反之 ， 划 果 ? 是 有 有 限 调 和 的 ， 则 出 567) 得 PK code, re) sj) = 
0。 对 1 ZR FRP( 一 co<<q) =0, EMER. | 

E DBA, WB UEC xa, BAY VASP RY E E G =( 一 oo 
<Q) Alle, =(-co=a@) EARAIL, ARMEEDE AHN 
链 。 但 我 们 很 容易 微 到 使 得 它们 是 逼 近 开 链 ， 

ER? 设 1 是 有 限 的 I 过 价 测 度 ， 其 Riesz 分 解 为 O). WE 
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在 测度 空间 (如 ,.F PRE MER FAIR (2,¢,6), € BI P 
征 测 Ben, WA, WEFR, =(-0>a), Q, =(= 20t), £2, 
(@=1,2)b, 4(2,,0,,8,) = (a, B), Wits, C, §)(@=1,2) 52 
O LBL, Emel ey, 

证 ” 依 定 理 9.4， 对 4= 1 和 2， 存 在 测度 空间 {2.,. 了 ,Ps) 及 十 
义 在 其 上 的 通 近 卫 链 (zx,66,8), 其 特征 测度 为 从 。 依 定理 1,; 可 以 记 
HA, =- woa) @,=(-cota,), 

可 议 认 为 各: GA TAAA, Faa UA, F ={A, ACR, 
ANDE F.a 4=1,2) SHF ELMA, HFF, HA 
EF, SPCAJ=P, (ANQ +P, (ANG). Woch, HeT, 
Af, 4 a(@)=a,(@), Bio) =pl), zn, =r, @), Wija M, 
(1,0, PEETER, S P) EAEN I, FARE ROR AE 
Mi. 


8 11. AS. 


HEA = Caii, jCE)V HORE, WRR fa RCE, 
AR SRM Azo i, ARR, AA 的 行 和 非 正 ， 有 限 。 当 行 
AAS, PORRAR RSH. WAEHERE = (a;i, JEE), 
A ito | 

Egy H o Ej, Sai,<-dicto, (1> 


记 = 一， 称 di = 4) - 之 Vs ASE RSE. 回忆 < 是 只 在 

i 上 有 单位 质量 的 测度 ， 令 站 

L1 ~ oe tna, > 0, 
Os ina; =0, 


PT LRM = (h; CE AHORRARE. TRAO 


D PETAR, REHE AERIS GO. SP PHASES P. 


M=} (2) 


. ZG». 


AE, DLEE, WE = ELU191, Argan, =d;QlOE), G:=-4ss 
= 0, MOQ,= (g, i, jE E;)}) 是 保守 的 SH. O MRA N 
EO KARI, =i i, CE OMS RB, WR, 


qi H= 0, fobs, 


A> O, + 
AA = (i, QCA) = — CA) =A+G, 
MIA) = (aA), i, FOB) AEC ROME, FOR ARIE 记 为 
i(k) = (A), i, FOE), BRO RARE, AA- i A 
SAAT (A) = 7,4), 1,308). HOOR (A) 的 子 HE, 
mE. 


maay TACs, i, jer, 


d. | | (3) 
HM; (h) = hag (EE), H; =0, JEE; 


ce, DL 的 第 9 行 全 为 堆 ， 其 余 的 行 有 行 和 为 壹 ! 而 WAS 
9 行 全 为 零 ， 其 余 的 行 有 行 和 小 于 者。 因此 ， 对 于 任 全 的 到 WA 
io HUE, (A) (20,8), MRRP HATE, ecd 
=8, Wee PRA). BRB = 6, 


id. GA) = S CHAD", (4) 

Pil A= GANA ta; L, (5) 
ROCA) = {pi A), FCB) E Feler RRG S {fiy(t),- 
i j EEG SORRERA BR. AAA Db S1, tke GOZ 


+oo, FATE BARA ARCA AE HR, 
引 理 1 Cy OORT. OE, MRR PEL ROE) 
是 链 首 出 E 的 时 刻 : 
d(E)=sup{n, yin) ZE, €nad}, 
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则 ace) = {0 加 = +00, Wå +o, IO CE, 
6-1, WML +æ, yO =P, 
(6) 
FLCY 0,608) FLA ER, 

证 YOO) CE, MO<C(E), RANA Teas. 
故 链 内 可 能 在 有 限 的 中 渐 时 刻 8 到 达 9， 因 而 得 (6)。 因 为 (3 ,09,0) 
FT (AE, O00 BD ERO BE BRIN, WESC, 

引 理 2 谈 人 y,4y 3d) BUN (ASE, Hit OCD) RETIRE 的 
Ay Za), 
sup{n, YOD Ck, ‘exn=<d}, (7) 
—co, MRLERAA ER, 
~ co, la=d, y(d)=8, 

AS 8(£)=<d-1, Maecd< +00, y(d)=6, 

6, Wié=—co, Waad too, VG) CE 
Ey, e, 008) Si CR) = (- co<0d(B)} = (= C-oca, 
 ¥(@) CE) EEWO HE, 

证 EAGLE AIP pjene, oY ,@,6) RAS Ca, oN, 
<0, <0) |. AT (A SEO, 0.0,), GEO. 0,0, AR FEQ(ED NA, 
Lit, Eai PEW, OOF, E aE E, & eE) = 
Cn MÆ E, (Eje, M He, EER) EMBRIO e, 
SED RA, (E S= (a, (E EN, exa (ED Ed EB as Ds 
&(E)), EROE) N Q, = 90E) ,9.(BE) 正 是 2.CB)7 上 的 MG) 链 
(yO, 0) H HERA, WSIE, 2,CE) Eee Oy,.0,6,0E)) 十 
THN) SE, BR DLC, OCB) EE) EAB) He, HEE. 

FRR, BRP AME Si, wR OCA) $E iE IT 
HO SH en a OER BI BEL A, FEI Fo REAR PL 
se ay PES A A Se eR ae. EE. PI Ep a, 
AIRE MER) LAL ae. AEN SAS 
EATS RM. i, Bay Bead as a, de 指 分 
布 函数 
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dE) ={ 


C., Mt<D, 
1-e" imreo, 
Breede REAR RE, Ma. DAM AEP. Æ 
由 相 容 的 有 限 维 分 布 凤 {RG E i ES PPE ERAT AE ae Tal 
EXExXEx- ER ARB, 2E 

RG ilz sin) = Hi Gia Mi oa, (3) 


定义 I KO,F PANES, x BSW TORR, ton 
SDAA HW WR, PaS DA Ree Mada, WRAAE 
s MA Ey Borik B, (n> 1), A 

P(A, p, EB; y+ ,ps C By) = PCA FE, (B) F, (Ba), 

PREA ZF, pa 1) PI, 0 AT RE HF... 

ADH, MEEO, FP) REM T MER LSE Cz, 2,0) 准 
FAL AlN Z” Eo Somn, RAW WDEMESTY SP. 
Pa n=l), eeH(c,¢,.0), Casla 0) (SDs, 以 及 
SKA, (256, OU REOHALS HES, 

B13 RoR RATA EE Ue US ee F, 
PREFERE EAI. ,¢, 8), AME -<e JD 
Ayw EE, WH 


=| E GWP, JCE, (9) 
yam tad 


Ff) =| 


证 ” 依 定理 9.4， 存 在 测度 空间 2,7, P) 及 定义 在 其 上 
的 通过 I(%) 链 (71,81,61), 它 的 特征 测度 为 5， 周知, 存在 粮 六 空 
间 (0,,.9 ,Ps) 及 定义 在 其 上 的 一 族 独立 随机 变量 &, CCS BD, 


ECi) 取 0 和 1 的 概率 分 唱 为 二 卫生 ， 员 是 的 非 保守 量 . 


FP Fe A SF le] (2,7 ,P)=(2,K%2,,57,% 2,P,xPo), af Wwe 
(W,,W,JER, & 
ECE W) = ËC, WwW, J), ef wi =g CW), 
GE, w) = 0 (WwW, 
yin, w=, (aw), BRetw enad Ew), 
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T {+ WEEE = +o, 

ÖLE) + {yOCE)I}， MPE + oo， 
HAE + co BEtylO(F)]} = 1 时 ， 令 300) =p, MAHE, 
为 所 求 。 证 完 。 

引 理 4 B EAS RANTO ) 过 份 测 庶 ， 则 存在 测度 空间 CQ, 
FP), FER REM YUE OORO, 0), ER PLE F] (2;,9， 
EDNCGCE) MEEF RR 5S,,4EU URBEH(-&, 
+ cc) 的 子 集 )， 合 得 

Ci) ÆC- ee) LAY(QI CE, WAOS, 

Cii> FER oe = Fly, OVE, MepCU, SHE 
分 布 为 指定 的 分 布 F.， 

(iii) ÆR ZF, (21,0, 4) MRR BBA HA H 
链 的 分 布 ; 

(IV) ERa SP, BS, EU, (zi0eiltEE)I WE 
AP aH TE, 

证 PASEA ee Sa A, BEA, 

定义 2 WME. YA (2,008 VEA-ME SAL. 
infle=j<c, YS, MAW Re<n<yHncNn, A y(n) =2(n), 
WWE 2,0, DOE Ee MSI, (yer) Era 5 HAT. 

定理 5 A>, CORA RHIO HAMWE, WEL 
YERA, F Pee MER EAEG OEO, O ABH 
链 (x,a,8}， 司 得 (Xo,B) 是 (3 oy eh, (7.2, RARER 
FECA), 《zsayB) 的 特征 测度 为 


bs = EM tN DAMN + Gi (10) 
证 应 用 引 理 4. 存 在 测度 空间 0,97 PF) 及 定义 在 其 上 的 遥 
UT, (A) GEC ¥,@,0), 使 得 
Gsf E Cylvcmpidr, jEE, 
必要 时 清洗 ( oca, 9(@) =6)， 故 可 以 假设 ( - ooe, (8) = 
e250 « 


OER. FECQLF ,P) EIR OEL AELE (23,0,E0 
GEE), 使 在 条 件 (y,0,0) 之 下 ， 诸 (21,0,51) GCE) MERE 
Mae, IPERS (ya. OSE, (21,0,c MRED RIA 
Fe DTT ES} A 

fEC7 ie SGBIR TE ASE Cy ,8,0) K HERA OCH), Aig 
OB)Wy R= oy) aay). #07,0,~P BIBT) BE, 
它 的 特征 测度 为 Ex)。 


， = + oO = G4 1] +co 

会 p= 人 My ERY : Z ’ 11) 
?+eriy MByadc 十 oo 

MRON, esnash, BY 
vin), nay, 
x(n) ={ mE Y o 
2y,a)(n—-O), ARY + co ranas, 
(12) 


Be, (c,¢, RTE, FAB, 2, YER. EL (2, 
eD, 

FR BUT, OORO, e, DEM, E, Het., TEU 
hm Ay sae (2.0, DEH, EP, Bio, fi. ts WEE, ne 
i, = | | | 

A,=Pi2(0) =tog: en) ia), (13) 
BiigA,=A,_,T0, 。 _ 
fe(S) 5 LRG thd, BEM 
Rih; istisnai) =I CATH Al dg (AD, 


下 一 上 # 
(14) 
EEO) =, Cy), COD = ROSNO, KR 


A,=Pde(ds=t,,0°,207) =1,, 227) 
+P O= Io tC) = ty En) 
=P(y(Q) =i, eyin) = in, mscd) 
HPEY =io, sig. ecg CL = isg os 
fZ er CRO) =t,, ON) 
=P(y(O) =F, RN, iy, tt,) 


kE- Í . 
+ > P(y(0) =t,, ¥C1) =t, Vik) Tk, =k, 


h- Ù 
Zi 1 Stasis Bi, (n R= i)o 


m— 


由 于 条 件 独立 性 ， 之 中 被 加 项 等 于 


PC¥CO) = bas ¥C1)= iy 4 YC) = iy, 
= RIR inplika tin) 
= P(¥CO) = i, RCA; ts ot; MERESTE FT 1 G 一 > M O) 
- (thy 
*Rlgsteg py ttt ala. 
F-E A, =P(v(O) Si HRCA, Toshir thd) + 


t 1 
ot SRA Egg bys sls) 
Q 


有 
b- n 


Ati 
=P(¥C€0) =i1,){ RCA; ots ste i, i CA) 


i 


ali'n 


RA; lagii giy ACA t Gi ,> HH; 


E SRO bt Rss io ise}, 
EE o OOA +g O 我们 得 及 ,= 
Asaia tat 
pa c= | Ss CC a(t) dP 
A ot 2 ` 
=| > Cyny dP + | > CT tdP 
入 yap ho ee 


=A) S | SC, fz fay dP, 


Po Em peepee ij 
由 条 件 独 立 性 ， 之 ;中 被 加 项 等 于 PC 之 + ceo， = iG. M 


P< +o, y(d)=i)= SPH) =i, 6=n) 


m=490 
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A, 
A+ 


= 之 已 CC) = 的 一 一 和 总 (7 十 97 

ms (15) 
WECO). 

WERO, OF, (A) BE, ele, m Oad 引导 到 
1, (A) SEC Y,,0,5,), eaa DS FB Cenn oY 为 链 
(ye, DEBERA. BM .e,0)Bz,,0,6:(1CE) HR, 
(11)(12) 83) (v0, 7) BS SE (2, BRP, BA 01508.) 下 
(2;,0,8:) (CCE) HS, FEC1L) C12) RB 70 Oe Ye) 的 延 Fe, IE 
延 拓 正 是 (%,,0,B,)，。 这 里 是 (y,,0,5,) 首 明 E 的 时 刻 。 由 于 在 条 
PEF ODZ F, (21,0 e0CCE MER I, HAH 布 
BRIM SWORDS A, ITER Yn 0,0 2 FOR, RR 
ive Re, (2. 0,8, cee, Al, eM BIS, 

o Beene (4) aE (2,0, 80.0. ER BW E 
Ei EHER, 

E SEOD A DETAN +) Gia 


Ete, EOOD, BERA COO, E. 
8 12， 测 度 空 间 中 的 Q 过 程 


SRR SEE ce FEA ES [at ERTAS RS RE A HE 
定妆 在 测度 空间 (已 , 色 ,P) 上 ， 记 了 工 为 [0 + RECO, +), BE 
有 离散 拭 村 ， 并 用 单 点 co CERILE, i= EU (o}, 

定义 1 设 (0, 了 ,了 P) 是 测 典 空间 ， ÆRET, +J F 
可 油 函 数 。 对 每 个 固定 的 # ET 及 几乎 一 切 @E Ge), zii, 
ERRATE., WRN ERtCTRICE, AP(x(t)=co)=0, WH. 

AQ, D= i= iD S= o, zCt,@) 51, tlO(@) oF, 

: 7 (1) 
BX ={2(t), teTHlo, d) A ERANGI., WRN ET, 
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ICE, AP(ACG,D)<C +o, WX = {a4 FCTN0,9)} 为 随机 
HE, BS-AC DOET, iC WBPLORR, AH XT 
ÆRE Ga Fw CK RF (et), FETOLO,0)), T=, 
toot, BRPLIRX = {r(4), LiLo RAR, 

JEM2 HP) = (p(t), i, FERED, te 0 DiE) BH 
Be. EX ={a(t), FETC, OAM, MANE nS 
1 sto ET, tft 有 

Põe ta) = tog T(t Fag) = baa 
= P(x to) = ing Tt) = ba) Dintns i Cnr bade - 
| (2) 
PX Be ERRARE ABRE RI. WEP) pR A 
OOH EEE, BMXAQRME, BSP CF) FRR ES AR IS 
PRAY Fp te. 

定理 1 BxX={2(t), tET HI.) 是 具有 转移 RM RES 
POOHBRA RTE, ESET MR. PERF ONZ FSH 
PES BES BO SMI Mi RTA DO, Spi sg) = e711 Cb) 


a(h) = min(o, >), MIX? ={att), FETAC, oV EAS 


fe EPH CH) = 0 GLL EDES REKHA, fae, 
如 果 式 是 最 小 如 过 程 ， 则 和 是 最 小 20 入) 过 程 。 

证 ”利用 条 件 独立 性 条 仔 ， 容 易 证 得 ， 

引 理 2 ” 设 给 定 全 有 限 测 度 Y= (Vi，。iEE)}。 则 存在 爹 有 Ri 
EARLS P 及 定义 在 其 上 的 孔 链 (zz，0，8) 和 天 可 测 函 煞 ol 
(ned, ICE), EI, DRRR HAY, TRE .天 Cr,0 有 ) 
>F, Wp azt, iC EWR, BLOTS PFs Fi Bay 
BiH) iS a. 

ER, (2,0, 8 BRE MRE AE = VG, Ive BWR, 因此 ， 
引 理 2 不 是 引 异 11.4 的 直接 推论 。 由 于 Y 全 有 限 ， 因 此 依 通 常 的 蕊 
尔 科 闪 过 程 存 在 定理 ， 存 在 定义 在 全 有 限 测 度 空间 上 的 匡 链 ， 它 
以 * 为 初始 分 布 。 由 此 仿 引 理 11.4 的 证 明 即 可 证 明 引 理 2。 


= 254 « 


HME, SRP ERE SH. 
定理 3 By, (2,0,8),e] (n= 0 ECE) S| 2. oanh, 


下 一 工 ` 
全 P= Oe ony bo = 0,57, = >P, O=Tariie Wos tc, & 


A(t) san), ttt (3) 
WX = (XC), aiL ERDO, WIRD ANY. 

类 似 地 ， 下 面 的 引 理 4 和 定理 5 也 是 明显 的 . 

引 理 4 设 v“= (Vi,i1EB) 是 全 有 限 测 度 , 则 存在 全 有 限 的 测度 
RHR, F Pe MER LA 囊 s(%0) 链 (3,0,0) 和 .多 可 MRR 
P, PIRSON SEE) MEY, 0. NMRA HAY, ER TO, | 
0.025, Wo, pitino, CE) BRM, Hath ara 
Bi FE AAA + Ga 为 参数 的 指数 分 布 。 

定理 5 hy, (y, 0. 6), 0°, ef (ned, IEE) 同 引 理 4。 
AO EHD), 0, OF HEA, Mocn<d(E), & 


用 一 Partnyy TOG, Trey = So 


i= 


So, | mee EB) = + oo, 
gz io . 

TotEyrtL e WEEL +, 

(x 
> O's 加 此 (EE)= + co 
i=0 

”和 一 . | 
a | TouBir 1 WAE) = dc + oo, 
(tentp’, 孝 果 (UE)=0-1<+%。 


Wosi<cds,, & 
X(th=yin), MWB <ttee 
WX = (2Ct), aico POC) X= (x(t), 0<¢<o,} 
ERDO ONIE. WB HBA. 
。295 。 


§ 13. HIER QIE 


ZEA AH h “oo” SA ARLE, EAN ED,CE, 
Di tE, (nt +00), 

定义 1 设 0<o< to, MAELO, o) LUMIX = (xt), 
Oxi <o} pA UPR, WE RE RE: 

(i) XCO}EEU {oo}, XC EE, (O<it<o), HX AJER, 

Gi) HERIC, dJo(0, o), X#Le, dIpRAAAS Hk 
O BRAS’ 

(iii ER EiICE, WHERdcE O, o), XEO, OPA 
有 限 个 ;区 间 。 | 

HEM 2 HX ={x(t),0<t<o}A MEWESAM(O,F7, P 
LASER )OMH, WEER S=, ice, 有 

(a(t) =DECF, Plx(t)=i1)< +00, 
面 且 下 列 条 件 成 立 : 

C1) (12.2) PERO i, <cti tee <otagis bs ty, ety EE 
Rest, FLAPCt) Eee) RP Ct), 

Cit) XJ — i PURER Bk RR. 

(iii) 存在 取 值 [L0 ，+co] 的 主机 时 刻 序 列 m + 0, dX, 
={a(t,+t), O<t<o~1t,} fee MEQ, = (To<a) 上 的 最 小 吕 过 
程 ， 而且 XX, 的 初始 分 布 的 支撑 集 含 于 DD,， 

注意 ， 最 小 日 过 程 是 退 近 最 小 89 过程 ， 此 于 5: 可取 为 0 ,或 可 
取 为 首 达 D, 的 时 刻 。 将 近 近 最 小 8 过 程 限制 在 8 =(o= 0)U Co 
>0, ACM +o) LBW, CAERE. alib. iF 
P(X(0) = oo) = OR, EUR SOMBRERO. (MRI 
在 {如 ， 了 FF，P) 上 考虑 ， 而 将 参数 限制 在 C0, co) ae, W xX’ 
={X(t), << EFE hO. Ri JER poe 未 
DERDE. AAS TR ae por AX = {r0 0 t<o}, 
集合 (z(0) = 0c) 虽然 了 可 测 ， 但 其 测度 可 能 为 无穷 。 人 但 如 果 


+ 2756 « 


P(r(0) =co) = 0, WEIR hO BAAR hOME,. 
E3 设 X={fztt)，0<sft<o 是 还 近 最 小 & 过 程 。 令 


nA) = f, | Crz(i)]dP， A>0, İCE, (1) 


m= | | Giri) ee, ICE, (2) 
ipo 


Paw XH EME ny Xa ~ 特征 测度 。 定 理 14.3 将 证 明 : 
CACY, ASOM AIE ( 见 定 义 1.11.1), 称 为 X 的 特征 流入 族 . 
定理 1 | kt IE Re POW FAX = {e(t), Oto} MP 
GALT A a, TRA S| SO, = (7, 之 90) 上 的 最 Ah O it He x 

= (XE), O<t<o,), WHOL, W-MIclo, oO, 有 
lim X,(t) =X), tea, 7), (3) 


证 Alt, 40, to,=9-t, to. ClO, a), BXA H 
性 ， | 
lim X(t) =lim X(1t,+ ty =X) 
| nae she aot 


8 14。 流 入 族 和 逼近 最 小 过 程 


BN OBE. Bea yO Ae A aN eh 
A HOD O, (1) 
Mle CA) = 9A A+ a RARO ot ae. ES A, 在 
在 全 有 限 的 测度 ww 入)， 使 得 
(i) wv"(%) 的 支撑 集合 于 DD, 中 ; 
(ii) ONGA) AEA), Boo, WOGA) Y= bj, PE Day 
(iii) Aman, PVA AM ae NTA) RA EAD n 的 
击 中 分 布 是 v"(X)， 
+E GI) STF 
VILAGAJ A CAS, nt +o, } 
(V*CAIP(AII; = NA), 7 。 
Joli BWA> Oe. SHB BOWED, MAE ME 


* Z2O7 + 


(2) 


空间 (0,.F,P) Rs MEER EA IBIBO, (APEX = (204), 
O<t<o(@)}, A4 

(i) Ber, AX BAD, OI, We REX S| SS] oy bh sh (A) 
WEP CA HE 


(ii) ma) = f f Pocxcyiaar, jEE; (8) 

di) = P(X(0) = 6) =0, Piz(Q)=)4%0), (D 

这 里 PAY = MPN O, (5) 
FFA, MRE 

Au- uO = 0 C6) 


RIA, WEELKOO) = co 
WE ACCA) = = yh) (A+ gq) C1 ESAS BRANT CA a SE, 
511.4, AEM RSQ, +, P), FREDDY BR 
TE (\) BEC Y, a, d), E 
P(-co<la, ye) = 8) =0,P( - ooca,y(a) =i) = Vv) 
E- oa KL /LPRRA 


lim yin} = 


E = 一 


z E Z CyLy(m) dP, jEE, (7) 
o, e, ORD WHE AE), ÆA, F, PEREN 
DEF A M e Mei Ime EE, ERE, a 
O ZF, eo, pied, CE Waa, Mes pt 的 
条 件 分 布 分 别 是 以 和 和 x+9i 为 参数 的 指数 分 布 。 | 

RUE KEY, e, OR MENA, R(-co<d(Z)) =(a 
GOCE) =Q, MEENE), Wo = pi inns WEE) =6-1 
< +eco, Iep? =p, fE HE 


| > pndPp<+oo。 (8) 


aut eo 


e298 + 


实际 上 ， | > PdP 


ae Bald 


= 之 | Bm GP + f pedP , 


mea (e@mcacd (5) oe poe oe T 


利用 条 件 独立 性 ， 上 式 第 一 部 分 等 于 


| pi dP = 之 > Porn) = dhe at 


d N pekrouenjed } 


2S SPM =D Ata = DAMNA 


EE oN ick 


= $ mA to, 


icE 
类 位 (27) 的 推导 ， 第 二 部 分 等 于 
pydP=P(éd< +o, y(d)=@)A7? 


GS -c400 pCiped y 

=A D POE) < +00, Y(O(E)) =i, VCE) +1) = 8) 
ee) 

=A! SS P(E) < + 00, (AE) = DH 2 (4) 
Pek 


= 和 -1 SE, ANA FO) MET: (A) 


eG 


= SA As eM AVS + CO. 


' Bcd 
BIE MX = (eC Ft), 0<t<vi6)). & 
T.=0, T= > P, an<), CCF) =r (9) 
ook me - 
对 0 所 + 之 0(8)， 令 
ICES YC), MRT SET ays | 
XO) =o, MR -— coe, 
HEX = irit), Os t<o(F) APH R. 
BSE. C4) BAY. WP eX. EMI a GG) maiz 


CHE ARBRE), m) RE; Al +, SUED I D Ciya] 


CE E 


(10) 


= 299 8 


<+0, MiG RDP RGD. Atk, XB EU E e ER 
HIR, (OER, (D WFH: 
{fo CirzCi3didP = {,= CL y(n) JordP 


Soca ct 


-| >  C,ly(n)letdP 


[| 


=X | odp= SPaem=paray 


RSS ni 
=A = 130), 

HR, Eee HOO O, e, & AD, HEJA, mX 

BAD. At Aly 
b, = fra? Na +00, 
+ oo tne, = + oo, 

ety, a, O :引导 到 上 ,= (¢,<8) MARCY, 0, 5), 
ERE, 4r0,=0(6)-5,, WOLL Amn =e (b,+t), Ti 
X,={2,(6), O0<tco, be MEO, LAS RA EWA 
VA), HTa Cy, a, 0 FRR RR SZ, E 此 ， 
TEES On 0, 6) ZTF, 0°, PI =Kin*" (mad, LECE) 是 相 
HAM, WERE Ou 0 DZE, 0 和 pz 的 条 
件 分 布 分 别 是 以 和 7% + 9; 为 参数 的 指数 分 布 ， 按 照 定理 12.5 的 方 
at, WAG, 0, 6), 0°, OF (m 这 0，iE BE) 出发, 我们 得 到 与 (y， 
0，z.) 同 初始 分 布 的 最 小 CC 过程 ， 这 个 最 小 Get 过程 不 是 
A EEX, Mi +o) (bco), 因此，XX, 是 定义 在 
Q, = (ODEA AO KAW BREE 含 
RD, - 

最 后 ， +E 证 (12.2) 对 Ostet pee fo try o. 
ina E Be RIERO OO 的 最 小 解 盏 (= CBD. 1 JEE: 
Ara 


RRE, HE- oLa) EEY) ECE, He, ya, ATI, = Ca, 


500+ 


Z +o) (QO, EE, A too, Heo, 二 Tsong 40, Mg of@) 
-6,4 000), FRM OPEL, oh), AX, Ch) =a +t) 
ect), Bre | 
(OCF) = io, ey LO fag i) Simri) 
=HimQ, V(X (ta) = boy thy XaCbnes) = imet) 


因而 PLACES) = te, ry AC bmg = inp) 
=limP(Q,, Xt), y Xn Chor) Sima) 


= limf (f, X (to) =i) Breit. (i: fo)" P'i i silimi 
tpa 


-一 tm) 

=PCXCGE = DB At tod Pia, ime ~ fm), 
.这样 ， 革 = {z(t ，0 扎 t<o( 站 } 是 通 近 景 小 9 以) 过程 ， 定 理 迷 证 

下 面 的 定理 2 是 显然 的 。 

定理 2 A> 0 指定 ， K= (zt), oto) ) BIR 
QOH. BOM ENODECE, SoD BXRREW MZ, BY 

o(B) = [UP 0 SLO), x(t) CE}, 
-co, WRLMRG WER. 

则 Xe={X(t), 0 三 tol 上 EE) 是 定义 在 8(E}= (~ co<o (EE 
EDENE OCI, CRA- PE YR BEE (AD, 

定理 3 HA), A> ARAK, u> tE. MA E 
WEZE (2, 7, P RENE LM JB Ut +> Ot») et BY 
= {VG}, 0 <t<oCE) } ABR RHOW EE X = {rE 0 cto}, 
使 得 

Ch XEYE HH, Bo(F)<oA ATE LO, ED YG) 
= Ct), | 

Gi) P(y(0) =) =P =i), EWY, TCE, 特别 地 ， 如 
Hev= 0, MM SLY RY (G) = x00) = 005 

GD RTA Y RAD WA A, Wt. $ ot +o}, 7,9] GY 
ALX BNO, = (Ts 之 +o) FARROW EY RDO, W 


* 30] + 


{113 


head 46 BV) | 

GY) YA RIEN BES nC) 

CV KRIER AREG), A>O). 

(Vid XA SARI REAR Cn 0), ADO AUER RCCL, 
9)) 。 | 

W HEEL FEWER (CO, S, P) ERLI H 证 
VELENO: (E Y= 90)， ostar) 使 P (y0) 三 也) 
=0, P(y(ġ)=i)= v, WE 


n= | | Cay) diaP, jeE. (12) 


作 独 立冬 积 空间 的 技巧 ， 还 可 以 恨 定 在 (0、 匀 ，P) 上 定义 
了 一 族 准 随机 过 程 Z/= (2,0), Ot epic Ee), HEA. 
KV OZ BLE Dea, MRZE ANEA 
出 发 的 最 小 妃 过 程 的 分 布 。 

FD YY KAENDA. MERY = (W(t, Oxt<o(E)) 
FETA RANA E, Th BY AE Ane), BGY AR Ar, 
A g= {ot Mo(E)<o(@) RCE) = +0, 

OCF) + Ey cas) MOLE = 06) + eo, 

Hocico, $ 

xPO WROLKNE), 

Zatoia) (t— o(E)) MRE) = gl) + co, 

mHE oH) <t<o, (14) 
WIXSLY Az, BP OD Ret, WRG, BAB WE 
Zen, Wal ， 

m= {| itt dido = [,).  Cslvcoidtde 


(13) 


十 | 了 蕊 这 eol 一 0 (t~ o(B) dtdP 
fo (Boe gihe A san 
ed 
= ncn) + >| | |" CEZ) dudp, 
站 了 


由 条 件 独立 性 及 (11.5)，. 上 式 等 于 
© 302 


nh) + D PCy(o(£)) =1, (E) =o) + o); 


toe 


=ne) + S Piy) = Tiy 
EE 
nA AUSER DOS ETA 
iz 


FAIRE CNA), AD>O) RHE RE RR 1.11.99. AED. 

往 证 (iii})。 设 f; 是 Y 首 达 D. 的 时 刻 ， 风 7,4 0。 设 57: 将 Yo， 六 
和 天 分 而 引导 到 有 ,= 《Tn 之 十 00) 工 的 Yo， 了 ,和 入,。 内 定理 1，Y， 
ERS BV CORPO. BAX AY We. m 
EABAR S øA. Wit, mR AERX ER OE, 则 得 
ASE UE ROWE. 

TRAY: AZGeCHE WS, BH ap do 方式 ， 我 们 得 到 
X, #Q,b, MY AIZGCEDAB, H a3) ONFA, 我 
ESX. Alt, RMA, BEY Behe. Ada E, We 
$ ab CAOFRBARABRPOUWE. HE. 在 上 RBH 
FP, VERDOOWE, 

设 1,， his eela CH, Ot 令 


a À 
A= N GOD=), A= N OGD), 


e+. 


Rei, H) = > (2:44; ~ HH) = ty, Oi) 
j- 4 


要 证 P(A, 1) = P(A tains Chas, m fade (15) 
显然 PAL SAna t Bart Cra. (16) 
其 中 Ang = Pinas baa OCB), 

BR... = P(A,,,, GCE) <#,), 


Capi = = BPs teclo(B) Stns). 


到 为 (Anais Pap COED = (Aners Pap LOCEY) = Aue 
x Angi = Po = PCA DPE Cla ~ a. 


+ jüj « 


PAP tatu Gant pe bri tbe ap 
py A h AE 


Bap: = 2 POOE) ~ -0)=i, Roi, o(E)) 


= SPP ii, mt P py Cera- to 


bylai 
+ diP(y (aC E) 一 0} 
=i, OCR) <u, 4iCt,—-O(H#)}=1,) 
; E 
-e dPCy(oCE) — 0) 
=i, O(E)=€u, Zita = 0(E)) = ia) Pi 


nta+ 1 
“(i n+] = fn) 
== BLP. = af "+i Fade 


类 伏地 计算 
P(A. 15 tx oltre) = PCA,, feel OCB) Stes) 
P (fati = fads 
babes . 


BE Cu OP pig, rm) + PA, te COE) 


Stas). 


FHA (15), RE 
Pè Artis FOE) S aed EAP G, Chaey Fe 
Made | 


le YC Erri ta) y, | | (1.3). 
注意 L,;=PCy(oCE) — 0) =iy(0) = k) 


= > HEP CALA D Wish) 


m= 4 pebs 
= Gat) R= Ab) =A et Badi, 
LL, (4) =P(y(e(£)- 0) =i, (FE) <uly(0)=&) 


| e304 5 


= 了 一 S Ply(a) =, u<o(B), u(olE)-9) 


lt E 


=iy0)= Rk) Lu > Bh aby, 


IE 


但 是 > Pita)by = De By caya [Ve Puce dt 
Tes a 


leE 
+= — 
=a] et utn B Cut tdt, 
+o — 
saf e itp, (fydt, 


”所 以 La) =A f" eB Cd, 


dL; (H) = he" 4" Podu, 
fa tLe = tn; to 由 条 件 独 立 性 ， 
PALL, Fa LOLE) En) 


= D Plis YOE- mi, LESE) 
= DPn, YOE) ~ 0) si, Zits; — oCE)) 


= İnel + PaO ES taa ) 


; faa E i 
= zi ' Pip Casi Sud PCA, Y(CCE)—0) =, 


it 


OCE)Su) 


+ 
= > f; ' Pii, Cati -WPP CAL, e- Ea) 


5 ot i 
=A, S| P.. (d—wdub. , (H) 
ao t+] tif 


. 3045 » 


Litas | (d(1-e7**), 
得 证 (18)， 
往 证 (CV). RXERPOWME, WAHA. W 


| [etC aD dtap 
ge 


= [ve | Ctr(t)IdPdt 


{La} 
-| “ent j D yP ddi = DRA AES. 


= [vé]; 
WX BU RPO e, WM 


| ia 'C [ax t)]didp 
oa 


= lim fo [eC Le dido 


a+ = 


= lim Lv" br) Ty 


但 由 四 (入) 的 预 解 方 程 
P(A)= iu) + CH ~ NBC BN) 
及 (2)， 我 们 有 
V(HOCAD = RP 十 《下 一 AVIAC CA 
— p+ (HAAG) ENA), 
MAIV. EREK. 


$ 15。 全 有 限 测度 空间 上 的 远近 最 小 Q 过 和 


回忆 定义 7.5,3。 Bin), A>0 MAR. 如果 
lim Andi =M +o, C1) 


WIE CnC), ADOSER AR, 4 MSU, BATRA SR 
. 306+ 


fy, Mg) ZBA). 


定理 1 EX ={r0), Vico REREME Sh A, F, 
P) ERG POE, WETA DS, KEARE MEENA). M 
A), A> ERAR. 

证 仿 定 理 14,3 中 证 (Y》 的 方式 进行 . 

定理 2 X= (x(t) JO<tCojBeE MESA Bil E72 wa, 
F, P ERDEVER ZOE, ABREU AIBA CNA), A>0), 
M (nA), Api JER HMA E MR, F PRS SA, 
MEGA, AO) RE RRA, 


证 m= |a [oren ‘dtdP 
x o 


= | (1-—e°4")dp, 
FPL >O)< to, Ato, E (2) 
定理 3 ints), ASD SESE MAR. WFR RS 
H (2, FF, P LAI RHOWBX= (201), Oto}, EH 
TE Tit AA REE C104), ADO), | 
”证 ORE FEWEST, P) 及 其 上 的 逼近 最 小 
QIE, CHERAB RENO), A>, AOA), ADO) 
HIERHER (2) Pioba to, 清洗 to= OR. 我 们 可 以 假 
UQ=(o>0), Hm, #*, P24 esi. 证 完 . 
定理 4 (nA), APOBRMAROGAMAL, WRR AI), 
则 存在 测度 空间 CH, WEZ, F, P) 成 定义 在 其 上 
PIB VA POX = {x(t}, oto} ee 
P(¢>>0) = Hm nc )1 (3) 


. P| 
H(A) = | [ie ‘C,La¢t)Jdidp 


=| et H tdt, A>0 (4) 
Hr y(t) = PCect) =f), t>0 . | (5) 
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EnA) A>ORM RMB PRAM. E Cn), A >0) By Rlesz 5} FF 
为 ， . 
(A) 二 + ACAD (6) 
出 0 了 P(z(0) PO) = co) = lim AIM) (7) 
i RAR C7) 第 二 式 ， 实 际 上 ， 
P(2(0) = co) =1- D Pa) =i) 


= lim Aq(Ad1— lim àvøtàpi 
Attan Am F 
= lim RACAL, (8) 


§ 16。 非 黏 返 回 过 程 轨 道 的 构造 ，DYV 型 延 拓 . 
和 {DY》) 型 延 扫 
475 BUS RE Oe CP Ct BEX = (204), 
POT} RE MER R SACO, ©, PLEAR poH. m 
L(t)=P)(@<t)=1- D Pit. (1) 


R(= PES, EF -0)= 0). (2) 
dh ORE— Bice, BP; (+) = Pe |2(00 <8), 
Pm ® (nA), A>0) 是 给 定 的 概率 流入 族 。 Hitt) 是 
(nj(A), A>0) MSH RB. $ 


Acids 2 Hite), H(t) = {? MiO, 


1, t>o, 
H"+! = HSH, «ERER 
Mi= > (Li*H"), : BD 
ë = Ü - 
Pu = Piu) +f a- dMis), C4) 


引 理 1 ”存在 概率 空间 CO, ©, P), CHEATER BLO 
TEREX’ = {u(t}, aico HARI OX" = (24), 


+ 309 « 


Oto}, mel, EPR (nS 1) 的 特征 流入 族 都 是 (A), A> 
0)。 它 们 具有 下 列 性 质 ， 


ci) Co C= OU AOE a =0) 
(iD 记 4,= (0L +o), B= 0 >), 
p! P(Q,+; [ A,) =M, 


其 中 MM 由 (15.1) 确定 。 

(lil) ZEA PALM, SP, AA man) Amn 1) 
条 件 独 立 。 

证 妨 吉 理 10.2.1 证 明 ， 

定理 2 ”对 于 引 理 1 中 前 X* 和 X"(n2>1)， 


令 tTl=Q, T'i = Sot, os >o, , (5) 
"=g M= i) . 
HOSI, 令 | 
X(H =X- m) Mri! (6) 


MX = {2(f), O<i<o} A SRE, RBA AH C3) 给 出 。 

证 ” 仿 定 理 10,2.2 证 朋 ， | 

注 1 在 《65) WU eam, RS 

PA) = beh) + AO T" (7) | 
其 中 ZCA) =I- APAL, 

$2 HORF, BRAMO), >00 是 流入 解 族 时 ， 定 理 2 
HKEE, HRR PRD., 

3. ER HAH AXATE MDVH aH, 
EMAG), Ab) ARiezs 5,6). 24 7 CA) =@, WMX" 
DV EEA $ PDRE, Beco, RN DVM 
MAVE, WSR CREAR PS, SELUR 

引 理 3 RAHTICERIO(, CARMA Rf) >, w 
FF FE PBS (CQ, FP) ee ME ARADO EX = {[x°(t), 
Os to? } A — Fis Ut Re hOTT EA" = {a Oi<co"}, m1, 


= 309» 


GPM nS lL) KREWE (100), A>0, CIRE PAS 
性 ， | 
(4) r= Cot = +) (X-EN Ca =9), 
n= 0,1) 
Gi) HEA, =(0<o%< +00, X%0"-0) 200), Q,=(0,>0), 
刚 
Pí Quei lAn =M 
HrhMh (15.1) 确定 ， 
GD FERRARA RQ PAM <n) MAA" MSH + 1) 
条件 独立 。 
证 ”上 仿 引 理 10.3.1 证 明 ， 
定理 4 SF SRS AX? MR" RR (5》(6》 定 义 基 = {z(t)， 
oaio), 则 区 是 昌 过 程 ， 其 转移 概率 为 


ist) = BA + | Ht DaN, (R) 
其 中 Ni= > (RixH'). (9) 
amo o. 


证 优 定 理 10.2.2 证 明 。 O 
注 1 在 《8) 两 边 取 拉 岳 恋 换 得 


| _ | Hi) 
| Pi = By) + OE) TR (10) 
FEE (AFAR, Ct) Ree ee PPE SA, BY | 
£04) = 1-—A6(451 pod, (11) 
arpa - Q1, 


: #2 ERUERA A RR Aro, m a ieg (15.6) 
ax, pi 
PiXir) =i], Xir~ 0)=c00)}) 


1) 4o°=oR, zia- 0 FMM. 


« J70 » 


[ar HieEE, 
= | lim A9), i= oe, (12) 
P(c=ti|r<cso, X(7¥-0) =o) =1-~M, 
P(c=t|X(t-0)€H,) =1, 

AB LMR RR, HATES Rae, 

注 3。 定 理 4 中 的 如 过 程 X 称 为 最 小 @ 过 程 X" 的 (DY)* 型 延 拓 ， 
(DV )* RE RRO MERA, ALE MAHESH MM, 24 1A) = 0 
Ht, (DV) "REED RH, Hes, (DVM ERA 
VRE. RROAN DARKER AO, H 
VEGI AY * DS MRI. Pt, RAV ee ee 
— TA. oo, 


§ 17。 广 义 DV 型 延 拓 和 广义 (DV)" 型 延 折 


保留 $ 5 开头 直至 《5.3) 的 假定 和 记号 ， 并 记 4。= 互 UB,。 
4。 上 的 Borel 集 会 全 体 记 为 多 。。 对 于 〈5.1) 和 (5.2) 中 的 
LP, DART, %), 有 lmI(T， D = limh, (T; àA), WHR 
WR), 
假设 给 定 4。x FALO IPRC, +), WE 
G) 4ecaA dW, Ge, ) EPERE, Ga, ADSL; 
GD TEFA, GOC, ORS | 
还 假设 给 定 4.x (0, co) DL ASNT ERRA, ), W 


(i) Ha AW, (nia, 4), ASD RRA 
(ii) MA>OR, we, AORA DER e Peay. 
Rna, A), A>OM RRR RRR HH, Ca, tA 


Wia, T, D =A D na, HTD, (1) 
i 


册 引 理 1.11.4， 存 在 极限 


. $71 + 


Wea, T, A Wea, T), Afoe, 
> 


Cia, T, t)=Wia, D- SH,(ta, Eh, O) 


FHM SRT Woo, DAC, T, ORRERA. | 
BG Hal WU) ORR X={X(1), 0<1<09) 以 
(ala, A), ADO 为 特征 流入 族 。 则 
P(X(@-O)ET)=Wis, D, (3) 
PAX(o -0) EF, ost) =C(a, T, 2), (4) 
证 。 由 定义 18.2 SHER, (XH, 0<t<o} 是 开 最 小 9 
HE, i 
Plica, xte- ED = YPX =j, t<e, 


= 


A(o- pens > H, HAZE), | (5) 


于 是 在 上 式 中 令 # 4 0 得 
P(X(o ~ ner) alin SH xa, HRY) 


= limh Z n, (a, Ah; (E) 
= limW(a, T, M) = wa, T 


由 (3 & (5》 得 Ce -证 完 。 
流入 族 时 ， 引 理 1 也 成 立 ， 
Ar 


Fia, D, Ay- jetta, T, dE) 
0 
= ett CCa; r, Ed, bY 
ù 


由 《2) 得 
2312+ 


Fla, C, })=sWa, T)-Woa, T, M. (7) 
ENX 

1D H=, H G.D A) (8) 
UT, D= | fa, JA, COCO, T, -Dida ds), 


(9) 

Ki(P,t) = SUE, | (10) 
pif = ft) | 

+ [fa fa, Eod b, t -Eida,ds) , 

i (11) 


其 中 (i (1)) 是 最 小 解 。 上 面 的 Ptf) = 《pij(i)) 由 8 及 GC*,*》 和 和 
qie e ) RE — BASE. co oo. 

考虑 到 定理 15,4， AAR 积 空 间 的 技巧 易 得 下 面 的 引 
m. . | | . 
引 理 3 ”存在 概率 空间 (CQ, S, Pd, ERETT UE XENO 
LEER" = {XX "(OD)，0 志 tf<g}, 表 过 最 小 8 过 程 族 X; {Xa 
O<i<o%a)}, aCA n=l, AARET APL BRS (ao), 
acA, no, ihe 

G) P(X") EE) =1; 

GOD XD C1) RPS RA (na, AD, ADO), 

[iii) PC f*(a) CP) =G, T); | 

(iv) 7X’, Kt (aCA,, KI, FOUE An n>0) 
HEMT, i 

Wg SHX (o -0 =a€ A, 4 =X Ca), E) 
Micol=a'(f*(a)),; RWA = 0, X'={X' (E), (iay 
最 然 是 逼近 最 小 如 过 程 ， 当 o >OH Xil- saEA 时。 & 
XI =X? (f(a) Hic =o (f(a), BMSec*=0, Me 
Heese, PSE) RAO AX Al — PU UTE POT PAX" = (XC Ee), 
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Os t<o"} (m1) 16.5) 16.6) BMX = (XE), Oo}, 
定理 3 X 是 时 间 齐 次 NS RE, He RRR Pct) = 
CsGORADAK, HAEREA) = ADE FAA H: 
$y (A) = piho 


+] 4.) 4nda, V| SV a,db a) hcs, A), 


a= 0 
(12) 
其 中 
Fca, T, A= 全 mach, ] 
1, Maer, | 
Vica, T, A)= fa Ga db) F(b, TA), (13) 


Veta T, A= | Vica db AMVCb, r,s),. | 
Ae 


证 ”第 一 个 结论 的 证 明 可 完全 仿照 定理 5.2 的 证 明 进 行 ,这 里 
仅 指出 如 何 求 出 px 如 也 及 引 现 3 是 如 何 被 应 用 的 。 
PCX) =F) = P(X (t) 
=i, to) + SRG), 


HPPA. Mi l 
Riz ct} = pica" lgi etl) =], Tilt) 
| fa Jape! Eds, Xo- 0) Eda, 
fCa) Edb, Kib, t-s)=}, t-s<o™!) 
应 用 引 理 2， 上 式 化 为 | 
Rit!) 
-| fa fa, db)H,(b, t~s)L1*! (dads), 


J 


其 


LPP, Pap (emit, XP- EF)., (14) 


e Jld» 


因而 a 
Br, P= LT, tY, 
Letter, f)= \ (4 ja pir Eds, 

X*-1(o1-1~ gy Eda, f'-t(a) Edb, 

Xb, ob) Er, ot(b)<t~s) 
再 次 应 用 引 理 2 便 得 (9)， 从 而 得 ps(X(1) =j) 等 于 由 (11) 确 定 的 
Pult). | 

FEHR pu C2) Hy ae Pe eA A (A. EGD 中 两 边 取 拉 
普 拉 斯 变换 得 
uth) = i A) 


{4 {4 Gc,sdeynscs, Ky Dhi tieda, A), 


a=@ 
(15) 
其 中 
hitr, D= f e TIT, dt), (16) 
| |, 
在 (9) 两 边 取 拉 普 拉 斯 变换 得 
ner ,= fa P Gia, db) Fib, DAR? (dd, A). 
(17) 
由 此 可 得 
nr, A= È 4, Via, AIA (da, 4). (18) 


实际 上 ， 上 式 对 #= 0 BRM. RLR n= m—1 A 


L W"(a,F hyn (da, A) 
= fa [faae tov (6,74) ladda, A) 
一 l [fa V*-1(a,db,Ayhs (dah) |V Cb,T,N), 
FJ a 


< 315 . 


= | 4 hr Cdb, MV Ch, TN) CHUA AR BE) 
= |a, | A PI (db MGC, deyFle,P,A) 


=A AD, CH C17) 
即 (18) 对 4 = mph er, 

将 (18) 代 入 (15) 得 (12)。 证 完 ， 

注 1 我 们 称 定 理 3 中 的 五 为 下 "的 广 六 DY 型 延 拓 过程 。 广 疼 
PY 型 延 拓 可 能 改变 台 虐 阵 ， 其 原因 是 cg?" 未 必 一 定 是 与 的 第 一 个 悦 
Be, Fy BE 


PIX(P)EBlat'<co, X(a°—§) =a), (19) 
MPa CHA PAE. 
注 2 that a4 BY Riesz 5} HA 
aia, =el BA) +H (a, A), (20) 


DE ADVE SE Fa RR ORE AAR, Wb ii A R REL RAR 
Are. PH | 


| Gta, db) S'ab) =0, a€He (21) 
e i 


RS ft Hi | 
| „Ga, ddat) = 0, ac He, (22) 
ERA RY SC DV AE BRAT ADV" Ase iA. 显然 ， 
MOSER, JM CDV) * Al tH Spy DV Bee fi — ek, WM 
(DV)* HIER, CRXHB—-+ KR, WE 
PCX( a) =tlo'<too, X(o"—0)) 
(| Exe ~0), db)e,(6), 如 ick 
(| edxkw =0), dM), i= 
| | (23) 
其 中 MO- imli A, ADIL 


a jj» 


注 3 Bach) =0, bE Ae, MEW (22) eae, Aig ZDVA SE 
JAA (DV * GE — Be, ROSSER, Be. 我 们 称 
e(a)=0, aC Ae RAM CDV) * ERK VRE. RE 
16.2 注 3 中 指出 的 那样 ， 我 们 只 使 用 广义 Y* 延 拓 一 词 。 对 于 广义 
Y 和 弄 延 折 ，20 是 天 的 第 一 个 飞 既 点 ， 且 (232 成 为 

KX) sijo, X(o%-6)) 
0, M iEE > 
“Hf earo, db)M(5), ij i= 


(24) 
其 中 M(a) = lmà | |aCa, ADT, 
注 4 PAJE EMT. 5, 1 中 的 @ 过 程 (注意 ， 本 节 中 的 互 即 第 
BR PAH), Hac Ae, + | 
AK), M. aca es, 


yla, A) = (25) 
aCA) Lo. 如 a€wa,cA-f, 
Gita, | J he 三 J 
Gia, by =| Mae a Esme C Hay, E (26) 
AO, HERE, 


则 GC*,*) 及 了)》 满 足 本 节 开 头 的 要 求 ， 易 证 对 此 全 (*，,*) 及 
nt*，*)， 由 忆 2) 确 定 的 六 与 定理 7 .5.1 中 的 YA) — me, AE, 
对 于 (25)(26) 确 定 的 GG,*) 及 Nyt) SRO A EES Ba r E 
HE] .5 PAO ERY Sie. 
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第 五 篇 “ 生 灭 过 程 构造 论 ， 概 率 方法 
第 十 一 章 “ 生 灭 过 程 的 概率 构造 


$1.51 Ë 


ME={0,1,2, °°}, QE., DR, DE XCL.(OR- 
WERE, A OMEE KIO, BRE PEAR HH 
法 构造 了 爹 部 生 灭 过 程 ， | 

在 第 一 章 § SCS, EMR TT Lee RA Rig 
程 提出 了 解决 构造 问题 的 方法 ,极限 过 渡 法 。 这 种 方法 的 优点 是 ， 
PUGH KM, PANES, MRR MIB. OT He 
的 性 质 ,可 以 先 对 简单 前 过 程 研究 清楚 ,然后 再 过 渡 到 极限 即 可 ， 
因此 ， 这 一 方法 在 理论 上 和 实际 上 都 有 重要 的 沟 在 价值 。 例 如 声 
问 尹 [3]，[5]， 侯 振 插 [23。 

这 一 方法 药 逻 辑 基 础 发 表 和 平王 梓 坤 [1]。 该 文 构造 了 一 切 不 
中 断 的 生 灭 过 程 ， 性 构造 时 分 别 使 用 了 8 变换 和 态 变 换 来 处 理 S<- 
co RIS = coffe, FERAL IIR BP IE RA RU ERE HE TOE 
— RADA, Eih, SQ RELI, 2 RAE Ea W 
情形 作 了 统一 前 处 理 , 本 章 内 容 取 自 该 二 文 ， 


§2. 特征 数 的 概率 意义 


KARLE 3 2 的 特征 数 和 记号 。 本 节 人 允许 a0, X= 
s jiġ» 


{z+ EO}, ft 为 第 一 个 飞跃 点 ，T, 为 第 # 个 跳跃 点 ， 

TT 一 0)=0 或 oo0. (1) 
m ERRA BEX, ={2(1,), Tae} lett.) —2(t,-0)/ =1 
CTT), 


X1=P NV no Gol? > 24) 
TERI {ECT 9) 0} MEERES 
(2) 
Ai=P, _ = = G02; ~20)+1 . 
=P; {z(t -0) = 00} = ei (3) 
oF = . z 
约定 一 =1， Doo 0. 


证 出 定理 6.8.2， XE fiS -ar HOS) 的 方程 
(5.2.19), WRS 5.2.5, 


X} = [a(i ~ go )+ 1]X}-a,(2;-2,). C4) 
类 似 地 ， XH BS = 0(i 关 0) 的 方程 (5.2.19)， BX fi 3|FH5.2.5, 
Xi = [ag (2, = Zo) + 1X0, (5) 


HEMX'+X*= 1, WERI, WX =0,RX*=0, Mix! =1* 
MRX S0, WX? >0, BIER MM (x(t -0)= co} bk, KRU 
EM, | - 
X asm = Plalr—0) = 0ole(ty), LCT), oy TOT)} 

1, . 

BEX; -Ti 00), WI Xio, FRM (4), (5) 得 0= 
[ag (2—-2,)+ 1°45 -—4,(2-2,), L=[a,(2-2,) +11X%4, 从 而 
Hatch, 


Xia Gal- Za) Y? l 
° do lZ— Za) +17 ° gí Z-Z) + 1" 


RAGUNDA (2)( 3) Haco ir. 按 约定 二 = 1,12)(3) 对 go2 


= 0 也 成 立 ， 证 毕 。 
+* FI9 = 


ga = (63 
sc， 如 果 上 面 的 集 人 台 为 空 集 。 
显然 Pi{E t tissu f co) [x(t -0)= oof =1, (7) 
定理 2 whicck<cn, 
_ ay £ La FA FE 
P.{Ei< ónt s Prtés <E;} Z,- Zi . C8) 


证 wie 6.8.2, R= Pali Ce. EE fi=1, fe=0 tik 
所 RB) 的 方程 (4.4.11}。 由 定理 5.2.3 和 (4.4.12) 得 (3) 第 一 式 ， 第 
LAMPE) PEI 1 得 出 。 


定理 3 Wisk, 
2 Z _ Co(21— Za )t1 
Pi{Ei<t} zo 2, PiE r} @,(4,—-2,)41 Zz iT 
<9) 
Pi{v<é;, x(t-0) =} = ne (10) 
TE 因为 在 {xt0)=K} 上 ， 
(SEE) U (<8) = LT), | 
*#=h+1 
(EE [EE rE 2(t~0) = 00} 
amh+i1 
(11) 


E (8) 中 了 到 极 限 得 0 第 一 式 和 (10)。 其 次 ， w= Pitot) 
(O<i<k) WIR WR (5.2.13) Pn=k, fi=0 Gk), fa = 1B 
形 。 由 引 理 5.2.4 得 9) 第 二 式 。 

定理 4 peicck<cn, m 


E,{&:, Sem} = = in Fe > Ža 5 《2 一 2p Mb; 


Za #4 tl 74 
2-2: wie 
二 上 te, — Zi 
. ae <1 ao 


(12> 
+ 320 » 


k-i 


Ex{Eny ELEZE D F ay 2 


Zi jaga Ba 
1- . 
Zen ži 人 ži 
. . =-=.: .— ——. -一 zZ —2Z;) 4 (13> 
24 一 之 i 之 za nei 


证 由 定理 6.8.2 和 定理 2， = Eh, CER HS, 
=0, fia TOT GLACO RAE (4.4.11)、 由 定理 5.2.3 和 


(4.4.12) 得 (12)。(13) TW tH, 
_ = 2 
定理 5 E(t, sr 0 oo) FTE 


l A 
2Z— ZF 9027 2+t1 
Glz- zZ) F155 Falz Z +i 7 


Al Zr— 20) +1. < ACZ; 2%) 41 (z= 2H 
a 本 


apk Z) +1 fT, Tl- ži) 41 


十 


(14) 
证 m= EEn x(t~0)=co} (hn), 

We He 4s, = Pelele 0) = 00} (Ron) f= Of (5.2.13), 
#5) #85 .2.4, 


E -=cot 二 -am alo 
f--] 
Ba SS Dt 
4,027,-2,) +1 24 4,02-2,)+1 
| ot 
p 20624720) 41 a,(2%,-2,}+1 TERETI 


4,42,-2Z,) +1 (7; a,(2-Z,) +1 


(15) 
HE (7), FEL PRR C14), 
定理 6 iza,=0, 
Gi) 念 co 为 从 # 田 发 经 有 限 ( 兰 0 PIRRE, m 


PH = Ph {EJAT} -| g-2, (16> 
gaa,’ MARR, 


(ii) 景 小 8 过 程 X 常 返 的 充 要 条 忻 是 z =o, RN z= oo, MA 
#-06 


(iii) mi, Ni, RpgQC5.2.4)—€5.2.7) E, W 
mi= Eini Ni= ET, R=E,t, (17> 
(iv) Pyl{t<co} =1(4CE)RAB RHR AO, 
证 (i) 由 @ 得 出 。 
《ii MOS BFS 1) 4P MEE a o Ss 


* b, = ER] 
fi = a, + 5, Pfc = z-z, Č 


HER = 1 即 最 小 过 程 常 返 的 充 要 条 件 是 z = co。 

CGH) 4o,= 0 时 ， 在 (15) 中 取 = 有 一 1 得 Bi16& = 1. 
(14) 式 中 2。 = 0 时 就 是 (17》 后 二 式 。 

Gv) A O17), MER, WRL, WP, {roo} =1 (RE 
ED, Rž, MAH AOD AAPL ito} ai, MAE 
HH6.8.2, H(A) = Ele "0 (D0) EDU A) =A), & 
由 号 [ 理 5.2.5， 


Wk) = MY +h D (2, auja 


24=0 


一生 


LEROS, Gt), Wiru (A) ean, (A) D (241-25) ay, 12 


AL, CAR, WR co, HEB, 

定理 7 iga,=0, S=oo (H.L TD 
WwNX=a(e Ct), tole Z, (Q). Eik (8) 确定 。 Wet A>, 
El{e Joco, 

证 BAW  HRAA RPA ODAH I-11, Bu CO) 


oe 322 +4 


-Efe }lazo Citoo), Hye 6.8.2, wy CAdS1, Duio 
=A (AG>), RP 


wi (A) — 0, A) = Št Euith) E {I+ Ana), i>o, 
| i 
重复 应 用 上 式 得 


证; (A) uih) = bibirit bisiet oa CM) 
人 


一 下 ii 


uj(r) bibrs Ops itt te CA) } 
+ Af Bio. + yy tat iE 


fig ilia Li Fiti 


> 对 -+ to, 


ay Peg Mipit Gisti 


Ajoj wm) -mahe 从 
Í 
而 lu MNU O) Nh Dex Jae 


令 i->eo 得 1I>XNSa。 因 3= co 。 故 wa= 0， 证 符 。 

HES 设 ay=l，3S=co。 风 PTEscol=0。 KM En 按 
(9.4.1) AE. RAS, BPOMBXE 2.10) 都 纯 自己 流入 ， 
或 者 说 ，X 不 可 能 自 “ce” 流 入， ee 

WE IP 全 -<<a)=0， 用 反 证 法 ， 记 8 = liao), B 
PCQ。) >0， 显 然 纪 .由 ，( 计 ) 记 Qi48( 计 co)。 南 引 理 9.4.3 及 强 马 
氏 广 ， 可 以 在 概 求 空 间 (Q, A F, PORD 上 考虑 过 程 Xi = 
[elini t i), ILE % OPM AHR RRR, OF 
P(xi(0) si hjel XACML SMS). A 


with} = Efe-it S23} | (18) 


EADAR AEE, e (18) MERE ET h K 
一 发 ， 轩 而 Wh)I0 (ite), 
另 一 方面 ， 
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1. ef i aed 
Hih) = re dp> Pola! 0dP， 
MERE, Eiin, 教 
wi A) =e FO fe aa dP >O, 
BeO LO. 


FHP (Eng <0) = 0, Hi>o, 
PL Eng OO} SPE <<} Il; +6," 


RPE. <o}=0, 


83. 一 个 推广 的 邓肯 (IPIHHKHH) 引 理 


我 们 证 明 下 面 推广 的 邓肯 引 理 ， 其 中 过 程 可 以 不 必 是 生 灭 过 


” 引 理 1 设 X= {x(1), tf<0}E ,为 非 负 随机 变 景 ，9 为 

EBAT, WE PBR 

(i) HRs, t20, BAA, =(E>s}C Fo, MAAS 
A NGA, | 

(i) 存在 正 数 了 >0，2>>0 使 对 一 切 1EBE 有 Pi (Ar)<1~a, 

WAERD. EARME ESR, MAS RAR PE 
<t} HEE 10, 1, 2) oeo ORE, 
”证 BAC 78, Are rL, HIRE 

PitAver} SPA, NGOAr} = | Pec (And, 
<(1-—a@)P,(A,), 

FHEP CA) ad-e, BERPA, mS g), PEL. 
这 样 


TORDA 


nægt Taian oT 


Bidea S {n+ THP 
n=O 


+ J24 « 


el le 


SAT} < Stine pr} =m)" Lco, 
Hi. EREA te™ (1 一 DLI, my 
D> re ria > > see renee — ay" 


ig fag mod 


ef 
— Deer or qg- — a} = 


a ee ~ 


根据 [57，$15.4] 中 一 个 定理 ， SAN sr a ert SEE — HEE» 
bE}, 


$4. 不 中 断 过 程 的 常 返 性 和 妃 历 性 


. AREE, RNS RR TR K E, Wo, =0。 由 定理 
2.6, SA RMRCONBSE PR, RHE-PRR Go, th 
Plr<oop=l, 

定理 1 X= (x(t), cope a, (0) 不 中 断 ，7z 为 第 一 个 
TES. $ 
Bi =inf{t|t<t<o, 2(t)<n}, (1) 
则 对 任意 初始 分 布 ，Bi HERE ERY dSo EB, HEA 
BPR St} ARE BL! do) 于 一 次 定 。 
证 Ptz<eso HLT AXA PH, MESO OF 
Qe Palts) =P {rs, 2(s) GE} = 2 Polt<s, sis = 1}, 
因此 存在 i EB 使 Ps OCS, a{s)=f)>0, 但 P , (站 之 0 U> i 
ER i > 0 
a=P {Pst teP, {r<cs, rist+i#}=0} 
=P, {t<is, as) =J}pi,(t) >a, 
但 在 集合 {z(0)=i Bixsti} bh, WH (6.7.7) EXHI A 
MiLa, BiS miat. Bi. TÆ 
{1 =i, RSS ft} Cle) =i, pi, 
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0,， (AR<5+ E), ATP (B8<s +t) AORAR. cH 
Tesit, WP (Ao<T)ee>0 CEE), 于 是 引 理 3.1 中 条 件 Gi) 
满足 ， 条 件 (i) 满 足 是 明显 的。 依 引 理 3.1， 林 定理 对 n=0 成 了 江 .。 
AER <A BEE, TE, 

定理 2 ”一 切 不 中 断 过 程 XE 4。(Q) 都 常 返 而 且 遍 历 。 更 进 
一 步 ， 按 〈6.7.7) BM Mn eee Ent) AR. Mba aw 
Hep (nisct) SBE yt! ClO) 唯一 次 定 ， 

证 Aai<sicnStd, IAEA, 


$5. 两 个 引 理 


HX = (204), FCOFE HCO), 如 果 X 中 断 ， 我 们 可 以 取 
= -1 并 按 (6.6.6) 方 式 将 X 化 为 不 中 断 过 程 X={ z(t),t<o0】 
ELO, 其 中 Q = Cas) G, EC DUE), Hae =a, Gi 
= 4 1 1=9.1j=0(i,， JEE. 今后 我 们 将 认为 这 么 做 了 。 
Hitt AB RRR, T, APRA, & HE {2.6) 定 
M. HEROE, + 


, MRo<re<e 
f (7) = 人 ee i (1) 
引 理 1 «=k, + 
sal Fifi nT ) }. (2) 
Oat pemi ayn 
特别 地 
Hg: = By minté:, T)}, (3) 


则 当 有 < cp 时 ， 


ao = 一 P 
Hir= A 3 (z —2Z,)}(1—-—¢4 cajt? ity 
ao aX iad 


FATAL D e-z erst e Na, 
Z= žij juk 
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limH{,= 0, (5) 


eid 


MRES, W 


iim Hyi 
Ë = o Che 


-5 (2 ~ z (l= er ai thi ot) (8) 


Ci l—-it+4 


lim lim Br 29, (7) 


ElQ 于 一 党 a 


BoC, IDRE. 
证 ®ick<n, + 


Hi tw = Es > At wy a (9) 


Oar, amiads, £03 
显然 HtHisCnfoo)。 易 见 Bsf (TD) shee ents), 
. a, + bi 


利用 定理 6.8.2， ta = Hy BBS, =f "=0, Jaslo eaten Ci 
hon) 的 方程 44.4,11)， 以 定理 5.2.3 得 


Hi = 2 B wate my 


一 24 ind ti 
1 


+ op ži Sz, —2;)(1~ e778 Yue C10) 
aq ae jah 


仿 n 一 ce 得 (人 中 等 式 ， 比 较 《5,2.6) 便 得 (4) 中 不 等 式 ， 
因 R<< co， 利用 控制 收 敦 定理 ， 从 (引得 (5). 


因为 3< oo 时 + > Ly 而 


ae Seed. need 5 z= z) Laeta] thy Yee -> 0 
E Foy, ( X Bj Zu ， 
(kao), 


a F27 « 


LS 20d et OD ae p>0, 


ml 
Cio 


i-i+1 peed 

(l+oo), MAC BO), AWA). HAP He, A 
(6) 得 (8)， 证 上 毕 . 

E2 XEF O 为 非 最 小 过 程 ， THBP ERA, 
BE. WBE. M 

P(lim§i=t}=1, (11) 

HBA Bidet), eH lmpBi 关 f。 另 一 方面 ， 任 取 正 数 
eg, 10、 由 定理 6.6.2(ii)。Pfz(z+eu)= coy=0。 如果 了 =c， 当 
plimbi =r, WRT, MMI AM, THE, Ax (t+ 
eJCE, PHN + af, BET + En limps T + em. Hi 
全 的 任意 性 得 limpi <r， 证 毕 。 


S6. 特征 数列 


HEX = (ali), t<cope CQ) WIPRPRE. SBM 
9.5.1 harms, 28 = 二 9，TI 为 区 的 第 一 个 飞跃 后 ， 
Bis int{t| rista, saan}, (1) 
eye SAP AFA. deren, n a DEER, WAG, 
We Mel =Pi=c, BIS MIA. Jew RRR, 


BL=inf{t|tisi<e, TERG (2) 
变换 Wo Mtg, X= We p(X 

X*=9,(X), : (3) 
,我们 有 7 

g(s, C4) 


Bral, WEXE (Q, D HAE, Er dn). WMA 
rA, . 

定理 1 WX 2,10) 是 非 最 小 过 程 。 则 由 (3》 确定 的 X"= 
{e(t), to} r OOE (2, V Hee, WE), KE 
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V=(v4, nEss Eta 
of = Pta(Bi) =f}, (-1<i<n), (5) 
wv} =07 (2 vt tort Can) ~1<j<n, | 


i ~ 一 1 


` n 
a m =1 
opa(vr +40) /( B ort +o Cie 


之 vi =l, Su Do, j 
j=— 1 i =Ü 
(6) 
XARA HY FEES Eo = 0 CaO), 

证 ” 注 合 及 是 马 时 ， 且 P{x(8;) 汪 rn} = 0。 往 证 由 (5) Bie 
Vs ECB). 

FERALE {ait +8), t<o~ Bit}, HCD 方式 
MEM. AEX n+ 1 WHRAA RS) RRB Ae 
H, AQHA ROM BE. BRIE (eB!) anti}, Aw AME 
EF oes, 由 定理 6.17.1 的 系 《 注 意 ， 在 
生 灭 过 程 的 情况 ， 系 中 的 条 件 独立 性 成 为 独立 性 }， 对 
—~1<j<n, | | 

At=P(a(Bittyanti, Ay 2081) =F} 
= P{e(pit antl, AJP 2 CB)=ilx (Bit!)=n+1} 
=Ple( Siti y=nt OP (A, |e(Btt!y=n+1}v3 
= pët = Crain) Ut | | 
于 是 v! 二 下 ffBi+I) = + Pfa entl, A} + At 
HUST Ott Cys eb UTE Capin) Pio, 
pt =Pla( Pet aj} Avti oiL- Capin) Uts 
(-1Sj<r) 
pijut sott vit L- Cai], -1si<n, ) 
Ur = Uri roti rn CI ~ vtitl Capin) de 
| | | (7) 
Hbi, Me Mn A P80 或 者 对 一 切 n 有 


+ J29» 


P{8i=0}=0. WERI, WSS. 2A lt = 2 =1, WX 
最 小 过 程 ， 与 定理 假设 不 合 、 Fe Dv = P{BL<o} >0 (#0), 


git > vial, BERCEO) 


1AA pR, Hy ae HR, P{p,<oo} =1, mi. vl =O, 
> = 1。 
O 当中 断 时 ， 由 定理 10.2.2， 取 ze =1,，xy=0 G>0, 可 以 
PBX Hew Bhi AX = { Ket), t<}. Ap 
XG) =2(4), HO, } a 
PL z(o)=O0|e¢<oo}=1, 
令 记 为 对 于 XX 的 量 ， 显 然 8; = BL. BEXAR, P CBj<00) = 
1, Alb > of =P{Bi < 之 0}=1, 


1 一 一 和 


Hot, =0， 即 P{81<o) = Dvj=1, MMB, P (8< 


=i 

Bic <o}e1, BMITELS, o) PARIS T= (< 
mM) PRL, HE HEG.7.1, Plo=co}=1, BCH ey, | 

JELE" = 9,(X) 是 CO, VORB, $ X= {riit i), 
t<T5.,7°85} (m0). BUX: ZO BRPOMH, BAA 
PALO. 3. AERC), HR< RPT <c} = 1a Beco BR 
HOAT ir —Pecoo, PREG. 17.1, 

Pleo} =j Tne ~ Boo} 
= Piss.) Ej Baca}, ajan, 

因此 性 质 (iii"》 EAE., PER Civ oA = {rti Wen 
X 的 强 马 氏 性 直接 推出 。 不 难 验证 ， Xa (mck) EF 可 测 


« 33) = 


BI, fox, (>A) er’ ,可 测 前 。 XE SEW {Oty Bi 
ee (BO), EHO .17.1k, HE GV ORR, WER 
10.4.2, XXn M> HM (10.2.5) (10.2.0 确定 的 过 程 是 
(O, VRAE., (KR REX = 9.0%), ue, 

定理 2 对 任意 X={z(i), tL} Er), AP{la< wo} =0 
wi. 

证 CHM Bh HEEE. BX 中 断 并 且 
非 最 小 


由 定理 1，P{pB; = = 0} =1~ Xeo, 即 


P{Bi <a = 0} + Plato} = 1, (9) 
He hy RPE, 


P{Bi<a=co}= 之 DiPifo=co} 


450 
但 ws 三 Py{g = 09} 满足 方程 94 =0， 故 ki 为 常数 ， 即 Pj(o = o) = 
Pig= co) FICK. KORA 


( SvtPw= 0} + Piece} =, 
由 定理 1，0<- 2rd, 因此 从 上 式 必定 有 P {0=0}=0, P {0 


<e}=1, EP, | 
WMS UK H{e(t), to} 2, (0) 为 非 最 小 @ WE, ya 
存在 非 负 数列 Pp，4，r.(n 这 一 1) 满 足 
Ftgqg=1, HS= oHa=0. 

r7 O0), Mp O, 


on (100 
0 一 PrN oe, WEP >, 
a= 
ue 
= Pir€ Bj) =)]},~-1<}saa, (1193) 


e 73] >» 


两 以 表示 为 


2 Xe . 
v, TA, LESJA, | 
(12) 
Xx, 
ue =Y,+ Ay "iC 
这 里 
co Sho St P>0, 1 
A,= Sr Cig, d = 
1-0 1, 如 p= 0, 
x 一 入 Cn . 
"r+tA DCotd? (13) 
E d 
Y= roa +A,C,,+d’ 
X, C, 
A 二 O T? 如 果 p = 0. 
WHOA HARA RR, 
六 _ 1 4 
rAd 
r,C; 
P{a(m)=i}= 1 TA ag? WOSK, aa 
d 如 j= co. 


Lr-itAord >’ 


Day XHR— Bese. A> 0, Mir (a> - 1) 除 常数 因子 外 由 x 只 
一 决定 。 如 p= 0, lr. Cn — 1) AXE, 


证 分 几 步 证 明 ， 
(一 ) SR = Do CS orC AR TS (15) 
则 由 (67， 
0 一 4 = Set Spa Gee + Spot (18) 
ne aei 
Ons = D oj tit Crin (17) 
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Bline- DER, 而且 存 在 极限 ， 


Ss. R, l 

A + B20, a. tae. (18) 
如 果 P=0， 取 r= 1, 如 时 p 守 0， 任 取 正 数 r。 令 

r= ,>i 1. (19) 


ZH; RIAS RAJPI - 1), 
(一 ) 显然 pP+G=1。 又 PP= 0hr, = 000). MEP >0, MÆ 
PREA > OCA S 0) aA EE 


rN oo, : (20) 


This EHI<ce。 当 天 不 中 类 时 ， 此 由 定理 4.1 得 出 。 当 到 中 断 


时 ， 存 在 不 中 断 的 @ 过 程 和 满足 (8) , 故 也 有 HB? = BB?<co。 于 是 
Er? = EB! + E{r? — BY} = Ep} + v$E,t = EB} +udR<oo0, 


l Tiji Bis WBR LBI, 
Mt= 
e Mist az. 
显然 tri> DM}, 
. ind 
Do > Et! > SEM} = S Birt, 一 及 BT 


i-i f=] 


但 E(t ~ Bi, Bi<cB2}= Sutejri= Svin,, 
E(t, ~ Pr, BIBS} = D P(E: PY) =P Et? 


= >{ Sor (1 - Ca) } Ny, 


f—1"k=1 


DUN; > UiN; 
1-1 


w «o> Ett ST OR FAL?’ 
1- Bvid- Co) 
Aol 


a FFF « 


FAC 19) 4 


nco FA (20), 
(=) 往 证 512) 。 
由 (18)(19)， 


.21) 
1 ,如 P= 0。 
KO UBS, m>n, 


vi = VF /ða.ns. 一 Li 


vi =( S076.) / ms . 
jan 


O< A, 一 A af Goan $ 


Maie rrara rg a 


(22) 
On. = > vet D UFOn 
1 -—1 i-s +i 
由 此 及 (18)(19)， 
Sot’ jee 外 一 二 
De int 一 Sy 
A. A -了 之 Ent KC 
从 而 当 m 一 cc 时 有 
op} ] < oa 
Go 628) 
By (19){23), 
anej on 
从 > Fi S rn 
1= Sof sAyi--t +228 +A ， 
į =—1 d ao 
FB] tte 


_ rG, 
E (r_i; +A,>C,g POF ° 


代 问 (19)(23) 让 并 福 意 (31) 便 得 (12)， 

(p) EA. 

WEXRPE, M1=P(Bi<co}, HRB RP, P(e 
"}=1, WI ILF HWEL, X(o)FEL0, m8; a) ) 中 有 无 穷 多 
AMER, Alii P{limsi=co}=0, WRT, 由 定理 
2,Pla<co}=1, HAMEL (@)<o(@), M BOLTI (@)< 
Bi 4. (0), RK BG.7.1, PLAPPELHBT =o} = 1， 这 样 ,不论 工 中 
P{lim$} =o} =1, | (24) 
TAK Rho, 存在 叭 一 的 [使 Bi- ,< ne <L UAL. 
Bp 

i, = mint A Eny, (25) 
By, = int{tln<t<o,e(t)<m}, (26) 

如 果 对 某 个 # 六 j= - 18) = 了 EAH. Aen 
NPI FRE SMT C (0, BIDAL Coo, M ELB n) E jR 
Ha Pe 2 eh AE BOS BE 1, RA RE, Mibin >j -1, 

{eC Bi =FIC(BI.= 4, cq) =F} {r= 让. {27) 
LARME =), Mia S>jA Bi =N, W 

(acn) = 7} = lim {a8}, (28) 

往 证 fz(9) = oo} = lim{2(8},=n}, (29) 
Th, Hoe He MOE.) Fon, AM ARE, oC ) 
= lima ¢ 8}, ) = limn = co ARAN, MEN tA, x(t) 
CE, MiG =7, Mirino, MoCkW, Hockey, mx 
EMO ELS I=n, WAAR BRAT) Fe) =F 00, 1K 
$Æ, (DRIL 

Ejn, 


P(x (BI) =f} = EPRD = jia} 
i-l 


s 335a. 


= SP {PI CPB!) =}, B BrT1} 


p 
=- S{ Zv: a- co} won = gi, (30) 


ĀÅ=}įi T 


P{xtBi,}= —1}= S P(2( ft) = —1,1,=1} 


上 一半 


os 


-5 P{B}_,<B%,x( 84) = ~1} 


oo E ye 
= > {Ea} vi, = A 


(31) 
将 C30)031) 代 入 (28)C29)， 并 注意 (18)(19}) 得 
Poe _ 
r_ ar 如 j= L 


P{a(q)=J}= 45 i Ca iMo<i<o, 


» hile = co 


去， 


再 注意 (21)， 上 式 即 (14)。 

(HD 设 5=ee。 由 定理 2.8，PfE <oj=0。 但 {r(1)= 20} 
C{E..<o}, Woie) =e} =0, 由 (3)(14}，4q= 0. 

(A) RBA SERBS, g, Fn > ~ 1) (10) —C 14) ae. 
(12) Mi RAPS PAE 因而 ”= ~ =0(n>0), q=a=1, 


Cis 
HE PAU". = r eT 了 -1 二 F 了 P_, 得 r_ 1= Faas 或 者 ?与 


同时 为 正 ， 根 据 (110(12) 可 算出 (18)， 雪 而 P= 了 ,4 = 7 再 由 
(19) 得 ry /rs = 07 /vei =F, /Pey TE, 
定义 1 称 非 负 数列 ,gmin 之 一 1) 为 8 过 程 自 的 特征 数列 ， 


* 于 了 而 


$7. 过 程 的 概率 构造 


EA EAE HR gr, (ne — 16.10), 
引 理 1 REIZES EXV C — Lj cn) 6.6). 


证 =4p=0H, vt =0(0<)i<8),v%, = tt, 


vis) __ 直接 验证 知 (5.6) 成 立 。 


r_,¢,,+1 


Hp>0, HERMTEM(6. ORR RY. W(6.12)(6.13) 
可 得 


. 再 
机 二 — + 
tepals See = Dy ojt tuti Cna 


了 一 一 


X., ~ 7 xX, = 
A... DS ret Yaar Cues A > r,C;, 


『 一 一 和 直 Pee nbd 


Knot lp pt Ay+ oh) = Must An (1) 


n+l + _ A, 
Ua 于 Te 一 “th ri + Vung nein 


Ansys 


X, > 
+ AC > riCin 


"+l 了 -a+i 


X, l A, Xa < 


从 而 可 得 (6.6) 成 立 ， 

引 理 2 设 六 和 {07 ,oci<ni(neSo) we (6.6). WES 
Sia, F, PER La HEX, VESIE A" = {r 
t<o"} C.2’,(0) (n= 0) EG, 4), 

证 ” 周 定 一 分 布 (v;) 作 为 初 妈 分布。 对 每 个 ,存在 概率 空间 
(Eas Fns Pr) 及 定义 于 其 上 的 (Q,V") Hani, = {5.(f,@,)， 
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i<( P,(0,)},(0,E9,). WEG., HMA, Zn = Ga %,) (2, 
Fa POER, VORR. kl. MSE AM; Sik), 
| PRR S01 ish), EEO SiS) A Wn marn, 
Hast sta), FE MALES) Hi 
Prong Distt sda) = PAZ C81 ,@,) = fi, LSS}, 
| (3) 
WMS} AMET AER. ELA A AES) KE OF na} 
FE AAS. HB HR RER OLEH, $1,1 定 理 11)， 
存在 概率 空间 (RR，F ，p) 及 定义 于 其 上 的 过 程 列 = {21 t< 
a") {E 
p{a"i (fi) = ji, l=ish} = 
(4) 
HERG) KEQE, Vo AATE., 其 次 ， 按 上 面 引 用 
HEH, HRS = (@)，@ =@(n,1) 是 取 值 于 E 的 二 元 了 沙 数 (n=0， 
1,2,°", $510,¢,),0,<0) #7 Hr t,o) =a(n,1),0%@)=0,, 
AMIN (6.4) ar, TE, | 
BAT = (a(t), fo") SE RA. HCG. 4), oaot, 
MA Sot to, | 
IDG DFAE AEA rh, BR", Hh 6.4), 
Bn? EBan "CF TERR R Ba = img o, H (6.24), limps 
= limga? =o", 到 此 


P{ imps= oj =1, (5) 
ynom, <> . 
BI" — Ti", ARBITRI" 
Li,= 
lo, 反之 ， (6) 
Ti" = > fT- th), (7) 


1 7 A m 
| 


RET XH EMIT KEI BREC, f A.) 
由 (6.4) 易 得 
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Ln = SLE Lo sms (8) 
i~- L 
TET TE aTi EE), 


MAS Lam t DaN foo), En y LN + o), (9) 
Ti T.i too), T. Tefo 
引 理 3 P{L=0}=p{T=0}=1, 
证 Sfp" = inf{tltrrt, a nam), 
MIRT i ID-T o METI, 


考虑 Lin} MEMA (Ti )， 
0, 反之 。 
> faTi Ti) MTF 
De etnai” LBI 
0, Riz. 


依 Lm 及 T° 的 定义 有 


Lan= > Llas Tit= Sry, 
i=l 


i=} 


fH ik 5[ #25172 (6.11)€6.12), 


co 


Elan = >) ELin= > D> Pltto<bi, 
sod] i—-1; -四 二 1】 


(Tio) = FE min(t ini PI- To STI.) =F} 


os fn it i—i 
sE S {EAOa} oH 
:=1i - 1 


i 1 
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ETP = > EP = D SP (ri < Bt 


i=} r=] k=] 
-$ > Felt] ja, TI CTY) 
7 JE rf grt min gr" — t0, 
bot E Ge ee a 
oS Ht rE i—i 
=k} = D B Sera-¢,.} ViHio 
PF. PB-1 °F -il 
w 


-1 


TV 二 
oe 
Diy + (2 Ci JHE 
ETE? tes ne 
由 (5.2.6) H RHEON, SN, (Cen), H3 F512 (6.10) 
(6.12), HiaN,, SirjN,<oo, limHio =0 $ S= co, tid = 


ind 


0; 如 S< oo , 则 limlim.res = limlimHs: =0。 因 此 由 上 面 二 式 得 


下 m ce no Sloane, , 
EL = limlimEL,, 
lim S r; HFa + limlim (~ MH. 
ke a m+ Pee ce A co 
On PAL td = 05 
ET = limlimET*?® 
zigas 
lim rH + lim lim (2 in FHS 
tła E į 0#~o 
7 r_, +A; vd = 0. 


由 此 得 证 引 理 ， 证 毕 . 
定理 4 对 引 理 2 中 的 ( 台 ,Y ALL IX" = fat), tf- 之 oy， 
H nik PRE = {r(t o) FE. XC es(8) 是 非 最 小 过 程 ， 


+ Jd) e 


AFERHE CE. 1D KE OWL, I RIXR AERA, a, r, m= 
一 1) 的 叭 一 上 过 程 ， 

证 (~~) Boo) 4aoc@) 存 在 。 往 证 对 几乎 一 切 @ EC 由 按 
ay Wee ELGG, HILE HEEL o), x(t ome ae Ep 
HAR AS. RTPA CLO,0(@)), 2° t,o BM Boo, 

不 失 一 般 性 ， 提 对 一 切 % EQ, MOAR ABRK ACO, 1) 
(sc(o)) 中 只 有 有 殷 个 克 间 (GEE，nz0)。 如 果 向 左 平移 每 个 
X" 的 每 个 常 值 区 间 RNID, MES RFR 
AAFe, WES, 8i (@) fie, (7, 0)= Teit, @) (nom) 的 
点 + 所 成 的 区 间 总 长 不 超过 2 + TC@) < 之 E+ TA@)。 Ak, n> 
mol(>k), WFE) > Bf (eye 

LIFI ELO, Bi (@)), alt, OJ$ Ealt, @)} 

SL) +T, pw (@), (10) 

Z= {L tT, 40, tt co0}。 由 引 理 3, P{Q,}=1. BECCA, 
HDH, ELA BaD PRELA, Ra ST in, 
一 oo 使 z(t， VEL, B op. 固定 一 个 
WIA, HF Doobit BAI “o” fh, WIEME EEEo, 
oj)=M(i—%), ATER, WA ESNIE 

Ta Cto, @)=M, (>N). (11) 
4> GE FETE IE RON tin >N felto, ©) =M, MI lto, oe. 
因为 不 然 ， 必 存在 msco 人 司 

talta xM (12) 
HERRI, Rg A = Xin angele, fol, KA 
ABSTME WE, SEF REA. 

FEREN, WMILF—WteClo, Bi a), zt, oi 
化 于 五 中 的 状 态 。 令 & com HH eC BiP R. WE 
地 可 证 同样 结论 对 [0，84(e) ) 中 成 立 。 由 (5) 知 对 几乎 一 切 !E 
Lo, of@)), a, ©) 收 敏 于 BE 中 的 状态 。 对 于 例外 的 + ELO, 
g(o)), MEG, 名 @) 不 收 诈 和 冯 so， 则 避 存 在 二 了 于 列 1Hi;, Ki 及 ME 
ERUDAI2D RY, HHS RRA. 


* 34} * 


(=) 往 证 Pfztt) = oo}=0, (#20), 
Hi), L{t|z(t, a@)=co}=0, AyFubinig we, FERT, 
LIT) = 0, Ht ETH, Pix(i)=co}=0, MoET. 
HEET. Wi mo. WR wet eT, tat ET, TE 
P{a(t,)2N} = limP{2'(?t,)=N} 

= limE{Pa",, [x(t —¢,)2N]} 

= E{limpz [a tai) 2NI} 

= E{ lim Pr, Leto — tN I} 


=E{Px,,,[altg-?#,)2N]}. 
Nof} P{a(it,) = co} HELP ce [atta wf, p= oo]}=0, 

《三 》 由 (一 }、( 二 ) 易 知 XE 名 , 且 是 非 最 小 过 程 ， 

(四 ) 往 证 XX 满足 (6.11)。 究 实 上 ， 按 (6.1) (6.2) HX EN 
Bir, (6.4), BIA Skt), BLA lim84"= By, limapi") 
= (81). 而且 由 (6,4)， 必 (B14") =2°( BT). SRP, MO<I<n, 

P{a(Bi=f}=P{er(Py =f}=07, 
从 而 上 式 对 j= — 1 也 成 立 。 

(H) BK={2(t), tT POWE (6.11), HEM 
9.5.22, KO, VOMMURK*=9,0X) RRM, KAI 
XEO, VORB RM RRR OW RRAR ERR, BD 
到 和 XX 有 相同 的 转移 概率 ， 因 而 是 同一 过 程 ， 证 些 。 


$8. 小 结 


定理 1 设 XE 多,(Q) 是 非 最 小 @ 过 程 ， 则 它 的 特征 数列 p， 
各 ，FrufP3e 一 T) 满 足 (6.107。 

EZ, BE PRAA, g, n(n Le (6.10). M 
$2 7E WE — OSE BAC 2.00), Dp. 4, (82-1) 为 特征 
数列 。 TH AB APEX — FICO, V Pee R RA FAA 共 
Hyt = tot, O<j<n) HRD, g, rn — 1486.12) (6.13) 确 
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E. 

XR pR ER ear = 0. XA RES 
件 是 P = 0, 

其 后 一 句 话 还 需要 证 戎 ， 

AUR ERTE, HE9. 4.4, ETET, PRUE 
USB KE, He (6.14 PRY Piac =J} =0C7C HB), Mitr; 
=0C0/2>0), FHRP=0. RZ, Hre=0. A 6.14) Brté.n<o} 
HQ(KEE), BHE, FRO. 4.1) BE. LHCE, 


PiE, <9} 一 全 庆生 Po< ec]， 


ay 
Her H1B9.4.2, Plésecol< E P{&;<0} =0, 由 定理 9.4.4， 
ki fed 


KWEA EHA. 


a 3dj a 


ATE ”两 种 生 灭 过 程 构造 论 的 关系 


Si 引 š 


SABA Rp, RMB AS Br EAH RSD 
BAe T Ca, = 0) 前 生 灭 过程， 自然 要 问 ， 它 们 之 间 有 什么 
联系 。 我 们 完满 地 解决 了 这 一 问题 ( 杨 向 群 [ 3). 

EER, REHE =0， WAM 2 正则 或 流出 。 并 且 记 
《5.5.1) KIX O XA), XA) = Efe" }，7T 为 QQ 过 程 的 第 一 
TERR. 


$2. 对 应 定理 


定理 1 设 非 最 小 过 程式 E 和 :2 的 特征 数列 为 卫 ，9，rCnz 
一 4)， 则 天 的 预 解 算 子 为 
C4) = ANEXA) 


> Febe OO dh 
k 


™ er oe ee ee 
rot Dral- XG) +dzk S Kya), 
i 


(1) 
其 中 dd 按 (11.6.13) 确 定 ， 

证 VON, VOR SIN EAH MART, MiGO. 4. 
B), 
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D UT aA) 


-9 
+ 


1- Sor + Sora- —X,(4)) 


ku kag 


156A) = PaA) + XA) 


(2) 
记 上 式 中 分 式 为 H?( 和 )。 特 (11.6.12) 代 入 H3(%} 中 ， 并 注意 


> vili 
下 ~ 一 
H(A} 二 
An 55 usd) + (Yat Ae DNC nba 
"k-o 
X, 
aS ry XA) + (Y, + T = ili) ~ XA) 


一 一 roy 
A, A, < 


#— i1 an 
之 rnp CA) 十 (G+ SiC jy 人 hn) 


— .. r eee 


r+ Er a= xan (hs S ren) = X,(4)) 


iat 


DS rnb) + (d+ Dren ) PA 
1 -9 HR > 


k. ð 


a --1 oa 
ryt Sorin XA) + (d+ no) 
下 一 刷 】 一 二 . nd 


注意 点, = SiO Lco, 2 流出 时 d= o. rh 5) 35.9 AT 


5.9.2, 
2 Pan g( A) + aX (A EF 


lim HY (4) = -———_—— 一 
rit 之 (1 XAJ} + dz EXAM 


BV. 0h) = liv A), AWER A, 
0 345 6 


因为 X = limx®, 


依 定 理 5.6.1 及 定理 5.9.3 和 5.9.4， 每 个 非 最 小 2 过 程 HA) 
有 直列 表现 ， a 
PA =H, ) 


D ahs lA) + DERE; 
E 


+AA) 


c+ Vad- + DAS XR) ite 
1 


| (3) 
pT Me> OM (5.9.5), BRDS On 流出 时 只 = 0。 并 且 
Dd abe (A) +DX A0., Ateo, 

k 


我 们 指出 ， 除 常数 因子 不 计 外 ， REG, 常数 cc 和 DD 由 过 程 
ME— RE. Si Ee tte, e, DAG, T, DATNA—WE, M 
apy +DXA)E AGU) + DX 64) 
Ay | A; 
HrpA,=e+(a, 1~X(A)]+DA (XA), 11, A HEAT, T, 
DIE. ERM- OF 4 WU 


在  @ D_D_ 

A, A ay ay 
Am KeA >OR GAR. 于 是 a~ Ka，D= RD, BRAC) 
得 c = KB, 


定义 1 PDPA, e, c, DUH., 
定理 2 (Q, 4, ¢, DIRDRI, 9, rnn 一 1) 是 ， 


r. =C, ra= aR), 1 


0 ， Me=o, 

p= | Az | 
Azt D" Mawo, (5) 
1 3 Me = d, 

g= 


—_ 


D 
AD. Meo, 
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RPA, = nici. 


证 RCD AD Bre HAARRaAT, 不 妨 认 为 r= 
mint), tr, ,=c, dz=D, BERGL 


§3. 过 程 在 第 一 个 飞跃 点 的 性 质 


由 于 对 底 定 理 ， 用 分 析 方 法 构造 出 来 的 〈《@，c，c，D) 过程 
的 运动 情况 ， 也 就 清楚 了 ， 而 且 可 以 计算 它 的 某 些 概率 的 量 . 

定理 1 EXELON, e, c, DB, BI (11.6.1) 
确定 。 册 概率 o; = p(x Bt) = 让 (一 1<j<<n) 按 下 面 方式 计算 


vs = Ate, vi = at CUELA), 
x aD 
a Xx, 
Ua =Y EAN D Beine | 
其 中 
D` 
=> 3 如 ws 0， 
A,= D>, Cins d={ Z . 
l | = ü 1, Rie= 0, l 
+ (2) 


Å Eno — d i 
n= CEFA, en td’ **" etA en td" 


Xn Cno B 
A, coid? MRa 0， J 


证 由 定理 2.2 及 定理 11.6.3 得 出 ， 

定理 2 HXECHL (OA, e, c, Dt, TAA- ER 
点 。 称 D 半 0 或 [#，13= co IBA, RD=0, Ce, LICOAHH 
B. Waos oo, 
0 $ HEA, 


P{r(t) =i} ={ a 
cria, 11? WEB. 


+ 3d7e 


0, HBA, 
< 


Plt = oc 00} = P{a(t) = -1}=f 
ctla, ij’ 情形 83。 


cl, EA, 
Place) sco} = | Mee a 
证 册 (11.5.11) 及 并 的 者 连续 性 ， | 
{z(t) =f} = lim{a(B})=t}, ~i<i<oo, 

dase BEI, | 


Pzr) =i} = lima, i=o, 
W e n 中 


Pla(t) = -1}=P{r= go} = lim re, 


An 
Ka 一 o Cne . Di Any D= 
Ea z(e + An Ong 十 D * A 0, 显然 A, 0. 如 J, 
An = 1 it 
w A, c+A, c+ie, 13° (3) 


实际 上 , A= Sa + Saon Hie, 112%, (3) BAR 


fad 


tt. Mile, ti<too, WC 3) 由 Dac. Dard 得 出 。 再 注意 
i-p i= 


Pla(r)so}si- © Plate) =i BRE, we, 


d=—1 
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第 六 篇 “和 构造 论 相 联系 的 马 氏 
过 程 的 性 质 


第 十 三 章 ” 生 灭 过 程 的 性 质 


81. 引 


中 


用 概率 方法 构造 出 来 的 生 灭 过 程 ， 其 轩 道 结构 清楚 ， 每 一 个 
生 灭 过 程 者 是 一 列 杜 勃 过 程 欧 强 极 限 。 因 此 为 了 研究 8 过 程 的 性 
H. RRA, Rea, Ri 
对 首 回 时 间 的 分 布 来 执行 这 一 程序 。 假定 ae =0， 并 采用 第 五 章 
AVIS, APRA RCA) ALP RAR VAD $, Pin X(A) 一 天 人) = 
H(A) 
Wiz, AD” 


$2. 最 小 过 程 的 一 些 精 细 结 果 


HX = {ri}, to} FPO), 1 t— A CRA fi 为 第 
TERR. $ 
a nen x(t) = i 
【oc， 如 上 集合 为 空 集 . 
为 首 回 ! 的 时 肇 。 王 梓 坤 [C2,: $ 5.2j 已 指出 :存在 Rah >, 
A> kh, Beka, WHET 
D.n? =Apy, Kj, } 
w=1., 


(1) 


(2) 
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ROMA. SEINE = Edny = Enj, ath kD A. WR 
关系 


i—i j 
Nij=! tl “3 NiF’ s (<j | 
Ni; È Giri 23) 之 ， p "<n (3) 
NSL 
RN; = Eft 满足 
= t 
Ni st S (zanz) È Ni In <lyR!, k>0, 
a | pare (A) 
N? =1. 
因此 ， 实 际 上 
i -ih 1 一 LPEE. = 
Fle j }= uA) + (kerf), 
Ee =X), ADO, (5) 
~ . i 
Byles = DAT, AKR, HKD. (6) 
EE n 
X R< colt, 
na I 
Efe y= Sway AL, apeh. (1) 
i-e it. R 


Sisk fj, t+1<], + 
Pa AIH Be, MANY 
ph) = Bi eM , nMh. Se (8) 
Ni = Ehi, mash, Nii Eini, nn). (9 
Pa a Efe, nT}, Prl) = Ete ™ , TEN}. 
(10) 
Nii=Elni, mcr}, Nir= E(t, rn}. (11) 
显然 j++ se 时 Pi =1， 且 对 fg J4 oo 时 ， 
Prig A) A Parad, Parl AD bo Per gC) A PaA + Pri lAa 
. (12) 
Nig Ft NE Niit aNs taiNist Nir (13) 
定理 1。(i》 存在 h =RG>O, HA>- hi, Paz) =l, 


a 350 + 


2, ISEDA, — WHINE (a=1, 2, 120, Leki, 
HERKEN 


t; 
Niy =f ote > (2 — 21 Ni sty, 
好 | 一 二 
nee _ 
十 -一 > (25> ZN iE fs tekaj 
op ři i-k +3 
0 _ Fs 7 Zk o 2 ， 
Nii; Z z? oN Tey zmz’ i< kj, 
(i4) 
Nis =U, NiT tag IT 二 DDN， 
p (15) 
0 oe eT i 
Ness qi + h è Zj- 2; 
eNi sAN T + bN ss}, 
(16) 


Push) = SC Ry Sat , USkcf, |M<ch), 


i= 
(17) 


ny WV) -TECN CA) 
1 Piz; )= u. JAVA) — li: CAV Y(A) ” | 


(A>O, ick j) 
by CAVIA Y — AvA) , f 


Pua = a TAVAS = m CAVAS 


(18) 


Pii ÀA) = 


A 
z“ Hie HOPO), 
NOR. (19) 


Pig (A) = os aPied rath), 
cii} 
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1 
Pu = SEES a0 BD = KAN) — KRM | ack A>0), 


(20) 
(A) = Wi Ch) Za 
Pu A) rra (a ay TET an 
Wc. Ve AY ,~ JED 
Push) = g (hin A) - A;(A) 一 ih he) ),A>0. 
FL a 2, _ 
N gi if Zee Zi De Zi JaN iF 1i 
ae S (z~2,),N!> DE \R'-4N,<IR!, 
teat 
i G<k, a= 1MR<oolita=2), 22) 
2-2 — , 
Nii S-a Ng =, Crick), 
Ni, = {Ni tarnNi_ nt +O Nigh llR’, 
， (23) 
Nia iy 0: 2 a j 
qi dt 2-2; 
N! =i NiF 14 by antah’, 
Nt. = betes | “24) 
2 Ei qi 2-2; m 
HR< cok, 
Pash) DA NA (isk, Al <-i) (25) 


i= ġ 


TE. (OA WA>~ AR. E{e™i} k>j), ACH (h< DA 


A, Peig O N i AF, m FL A WilksCi, 第 14 页 2， 
(26) 


Nei, 0€-1) a aPAE SUA 


并 且 (17) 成 立 ， 
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HABEEB., EONAR +a). feel 次 并 
注意 (26) 及 (5)(6)， 便 得 (15)7 和 (16) 中 的 第 一 式 。 又 显然 


Ndi =Pilaiccn, = Pi LM) EEH Pa LM), 


b 
aN ij = Pre Os), 


于 是 (15) 各 (18) 中 第 二 式 自 (1,2.8) 得 出 ， 
BY Fe BCE A] Fe pI, ADW EN 


t; = LTAL , 
(A + a,+ Data — Gelip — Opty = 0, (Ik) 
m; = LILT D 

2 


解 上 方程 得 (18)。 微 分 上 式 ! 次 并 注意 (26) 得 Ws = Ny CRC, 
[SDM eS H0,fe=tLNit, Gk), f;= ORM AHC4.4.11), 
依 定 理 5,2.38 和 (4.4.1I2) 得 (14) Baa, Bo (11.2.8) 得 
由。 
di) C12), #Æ(18), (19) 4] + co 而 得 (20) (21)。 
wR< com, HCT), Ikei 
Nit Nii a Elmin TOI} bri Ri<loo, 
HODE 
(22) 第 二 式 出 (11.2.16) 得 出 。 由 (13)，(23)、(24》 RER 
(HAART RRB. FELD APS] to, RE 
He OE HES (22) kta — LER ELH (22) HPA Nae Ng Nir? 
+ NIT RING. NI ARIE, MHA Ng + Ng echR! 
<o, AWR = 2th pear, TE, : 
定理 :。 最 小 解 常 返 的 充 要 条 忻 是 2 =w. EHME, 


m (z-z; Wi, 
{pdt = limd,, (A) =F;; = | ， C27) 
jf ro ‘3 {ca 2 me tj ci 


证 . 由 (5.3.2) 得 ， 
© 3536 


Wh) 41, (A490). | | (28) 


Hy(5.3.4) fH; 0) Sai mes ee ~ 24, 40). HOIN 


i= i 


定理 3， 设 z = -。 则 最 小 解 痪 后 的 充 要 条 件 是 ace, 


WE. AA(11.2.17), N} i= Miji | Biz 时 ,由 (22)(23), 
iNGi=1, 


E; = Ni; = (1+ am. 二 pa is}, 
+} 


1 — 
UNG 414 = (2544 ~ 22) > Us, 


ret -Ht 


HEE) <o P Euo dt. 


= 一作 
定理 4。 ER<, S<, W 
， PaO L XA) 
lim 也 一 =z, eth) ’ A>0, (29) 
l= Pnl) _ X (AX (A) 
me 7 z. A DX m to ae A>0, 


(30) 
证 ， 和 让 引 理 5.9.1 和 5.9.2， 从 (20) 便 得 (29)(30)。 


83. 过 程 的 不 变 测 度 


设 R<ce。 如 时 过 程 常 返 ， 它 必 不 中 断 。 反 之 ， 由 定理 11， 
1.2, APRA RM Aw. RR HHO A 
Dy tal yy + Dy 


A 


x; = limp, ; (E) = ——________—___ | (1) 


> a.N,+ DS ut, 
Å 


© 354° 


> akli + Di 
而 且 m; = Rm = — ——" —— (2) 


dil D Nat D Dips) 
k ke 


BP C2. 27S, N52. CE. 
WE. A (6.7.10), (D hae PR E. IBA Tauber) H Hardy 
(i, #8987), Tim A; 3%) = limp). 


HF Pi{t<cof=1, Xi) =E; {e} 41 ALO, X 
IXA Sena) Tis =Ni,(A 40). 注意 流出 时 D=0， 


Wt Saco, Bed (12,2,3) 得 证 (1)。 由 (1) 及 (6.7.10) 


得 (2). 
EE, EXC 2.00)48(O, a, 0, DWE, wy RAH RE, 


BH, RED IOl, DIle, Bgo, 


w 
ceo Sho 2 
nie 一 一 = =1, (3) 
f ef greca) Ide Toon) : 
MERE, RCO, EHLI. 
$4. 首 回 时 的 分 布 i | 
teL EXEL KOH, a, 0, DWE, 1402.1), W 
WALDO, | 
nin, 1 WiCh) | 
Efe (b= Thy” (icf), (1) 


Ei{67 } = 1~ mA) A+ G MADDA) +X) 


«+ 355 6 


4 


"| S apn) + DX (A ity j C2) 
k à 
By (2785) = Sh i504) + XN) | Sav + px 


SECTIES +X; oof > nb, 7A) + DX (A); |} 
k 


(iF), (3) 
其 中 m4) = Dal- KAM) + DA SX, Ada, (4) 
号 fe 


BLS OF Hi 


inv. i u,(A) ~ Vath) 
Ele My Je Piz CA) + PO) E a nee + 之 Th S 


Aad Ae rs] 


po (i) 
+ D ~y. i) {Sax 3 olxa 


,~ Xa CA) a 
+X, | » (tf) (5) 
其 中 由 (7) 直 (2.20)(2.21) ME. 
HE. (1)BB(2.5)- Fe Rast Chung [1， 第 192-193 页 ]， 
Pit) se tr | patt -udp OREH), 
pis(t) = | pua- wdPiC Su), itj. 


HEt, PERL C12.2. 336 Bit yee IB(29003), 
4 AG BOY") FEE. AX PNY BERRA Oi 对 让 = 让 
由 常 返 性 Pj {7 之 co}=1。 由 柱 支 过 程 的 结构 知 ， 


Et{e™"’)} = E; {er™i, nat SE fer, ony.) 


hom] 


= Qil) + SE, {ein os > VEe n 


-Í topes 


« 356° 


J 


= f 一 上 | 一 卫 
Fata) | | >, Uke) & 2, 


ka 6 


+ > Eke", 40) 


A=-ij+l 


= ish) + 915) fv, mr, Sy, 
k 


=r 


-1 
xfi- > DPA } 


Å= i+1 
、 Wh) — CK) 
| 609+ 90) [Baye Bay) 
j — -i 
SE vet > UT— > 六 二) | (6) 
A=0 kei+d * 


TEO, a, 0, DIEREX, CERKO, VO PER 
TEARRE RE AX E n At, et t 

$12.3. Dh RIVER A GH Anco, ÆR 5.9.2)5.9.3) 
《2.29)(2.30) 及 (2,20)， 经 简单 计算 后 便 得 (5)， 证 毕 。 
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SR ARERR EE 


$1. 引 


Ol} 


EAS By Fp eA ES Se eB TE FF BY PL 
E FoR FAS. EPAIA A SS Ee CEE 25 89 DE 
研究 可 道 性 时 ( 钱 租 、 代 振 所 [1 了]), 亦 非常 重要 。 马 氏 过 程 的 状态 
分 类 的 一 般 研 究 已 总 针 于 Chung [1,II$ 10]. 5357 L111 Rupert 
[C12 研究 了 景 小 QQ 过程 的 状态 分 类 ， 找 出 了 过 程 常 返 或 遍历 的 联系 
FORE Hy sew H. 

AH POM RA PA, RAMS AE. ILA SPR, 
PRERATO, EMT OEM WE, 因而 对 不 同 的 构造 需 不 同 : 
的 处 理 。 本 登 内 容 取 自 杨 向 群 [11]， 


§2. 两 个 引 理 


REIRET) WARAN., BRIO Bike. Ine 
一 切 状 态 i 者 常 返 或 授 历 ， 则 说 过 程 常 返 或 浪 历 。 显 然 , 庆 YA) 
TEHER limy; (A) = 00 «A (6.7.9) RJA M (Tauber) EE, iW 
vA) 3 FF 24 LY lima (A) =m; >00, MEH (6.7.8 BMH 
Mi, A 


t= I 


a 
diti; 


(D 


HA) Hedy 
Pi =P iAP HEA), TA, HAAS >i, 


a 558 « 


HEX EC 2°.0Q), TPs BB — Tay A RAS. 
Simi 244 4 Ont, 


bu tT = DH Ty, (2) 
Amo i 

E(A= Ber} £8 = Pit oo}, © 
An) tN = Tis= Bit, (4) 


FETE; 2101.9.7), 
EA) = 1-4 D uA). (5) 


HE (2) 7001.10.28), EPIS; Hi fe FBG. 2.198 th, 
优 定 理 6.12.3 前 证 明 可 每 


h D ouA) =l- E {e Ja €6) 
比较 (5) 得 后 (X) =E) HEBOG. RB, 
ED =- 四) =E e dt}. (7) 


由 此 得 (4》 

引 理 2 RX AHA, CAYO Bik, MPi{fo=m} a2, 
BEA GA) Fre MOO AER IB, MIP raosi, 

证 FAR LA BN, AAA Hie. MÆ 0) =i} 
E, XCASREB, 而 依 定 理 6.7.3， 第 ? 次 在 ;停留 的 时 间 上 后 


CaO Tae. oS Pt = co 


Fy R674, RYO), M 

Py{Xt@) 在 [0，co) 中 有 无 穷 多 个 区间} =1, 
MRH POVIER, 

P{X(@)ELO, TODPRAA RSME) =1, 

所 以 Pi{z< es = 1， 


e359 。 


83. HAE 


定理 1 eA CO, æ HAE, DADA) IERE, Mi 
为 $A) 常 返 的 充 要 条 件 是 


LÀ) 
&=1, > mé=1, Ekr, > 0, k—>i, (1) 
h a 
DRA VO Fee, MORDER H 


SS TN oo, (2) 
k 


注 Bamsi, ESI WICIE, DE > =i, Bp 
A 


BAIA. 
证 HERT, h3 2.1, 在 (10.4. yA | 0 得 
之 
ini) = Ij, +&,;———______ (3) 
1- 之 下 


设 i 光政 入 ) 常 返 ， 故 (3) 左 方 为 无 穷 。 依 引 理 2.2，&: =1。 其 
次 必定 之 TT <( > r, )Piu<ce, HERE. HADR, G) 
k h 


RA limy) = Fua, TA., BRD aat, WE m> 
Al D k 


PLAY 
0, T.>0, TRA St Fk St, WUD war. RS, H0) 
G82) RATA Rs. 
BC) ea, A | A a AE, AA(10.4.5), 


D Feb.) 


lima Ate, = lima rie,’ + limé; A Èo o 
A Te E OS ads ÈA 


» Jóh» 


PET 
j > avy " 
EHB., EMA EASY EAE. KEPO AD Ta, 
iE, l 
ba) 
Rl WHER j, i< Si, HOJER., WCQ, m) FE 
Site HigB4MB RY Yab, MARR, MRK 要 
上身 
条 性 是 (23)，。 
证 ”关于 常 返 的 必要 性 明显 。 充 分 狂 则 由 于 之 mel, E 
Th Rio, &=1, MEAE (1) WE, Be AeA 


E. LBAS, WORE 

系 2 HEL j, fei, ORM. MO, AER 
常 返 的 充 要 条 件 是 它 不 中 断 ， 即 2 保守 且 DS te = 1. 

证 ”对 单 流出 的 O, Piro latr 一 0) CB) =1, KHEM 
6.12.8, & =P {t<o}=1, 2 fF 2 ibe = 1 化 为 Zl. 


$4. 2 jh HHE 
引 理 1 | OP 3 FE. 11. de aE, | 
ALMA, ENLO, (ALO, (1) 
证 (1.11.40 REG TEO] MH. 
ETE? HAH... Pe, ONER., 
WALO REEERE 
X;>0, Seat t>, e=[a, X°]+0%=0 (2) 
Å 
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WERDDON., Wit ED RARR E 
> (as DS TesX) + 和 oo。 (3) 


Ebe pAn, CLO). 
证 仿 定 理 3.1 进 行 ， 只 需 注 全 ,由 《1,11.7》 有 


AKA.. DOXA Bruse A), 
AR S E LRT, 


FH ” 设 9 保 守 ， 并 县 是 单 流出 的 ， 对 任意 i ICE, ies, 
p(%) 非 常 返 。 则 VN) 常 返 当 且 具 当 c = La, X°] 40% =0， 


§5. 一 阶 过 程 


我 们 考 碟 一 阶 过 程 其 = {eCt), to} Er, Q), —Pid ex 
是 最 小 总 过程 芝 = {z(f7，t<Ti 的 (TI9，。，)，GE 了 Bi 广 立 有 P* 型 
延 拓 过 程 ， 其 中 (a，。》 满 足 (10.6,2)。 因 此 我 们 称 XX 为 {8， 
a，。)，6E€B,}) 一 阶 过 程 ， 

为 了 简单 ， 本 节 中 我 们 假定 由 名 导出 的 非 碌 子 流出 边界 B,;, 为 
空 集 。 即 流出 边界 Be 全 是 原子 的 边界 点 。 简 记 -x = B., 

根据 (10.5.26), {Q, Hla, +), oC} 一 阶 过 程 的 预 解 
CPM BR, oe 

bis) = BM) +S EXAGONALA), (1) 


eed cow 


其 中 
XI) = Bets, rr-0) =a}, ALM = SMU, EJA), | 
Al 


Vath) = SMa, k)XACA), | 
WAH Vath}, (FA) = {Vi ee 7 x x 方 阵 。 | 
j 


Gth) eo 人 VC 


Peg 
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(2) 


WRS 

A={ijiCE, #tfeac .x tEn, i)>0}, (3) 
则 显然 有 | 

Hi(a, E~A}=0, doo, (4) 
而 (1) 可 以 改写 成 

Pi) = Bi) + > YY Zir(A Di, AOA), (5) 

redAged 

其 中 


Zig) = SXIAN, g), iEE, 4EA, 


aoe ur 


DK) = > Zi eghh) a 


| 
PG= {Ze (AF, LEA) } = {Zi A) FEA KATE, L 
l ag J 

(8) 


显然 ， 当 和 10 时 
KINKI =Pi{alt~O)sa}, AAItA = Sula, ky. 
k 


RANK = {a Xip 17O, | 


Za) tZ = DXi, a, (FAME 


aca 


多 (多 = Y2, JANMA = Sr 
上 一 小 


feg 


j 


(7) 
RBRYO), FMLA), SU WERE AY MAM BK 
链 的 一 步 转移 矩阵 ， 故 可 说 o 为 70) 常 返 等 等 。 因 而 由 《1.2. 
10), 
Gua SGy (A), GaGa, } 7 
DA) ED Nh), DaDa. 


7 
引 理 1 (D zta, bE wf H MAGA) =0, Ha- 


b, WlmaAG, (A) = limAG,, (4) = limaG, (4) =0., 
Ala Abo +40 


名 
(ii) 设 对 某 r， qE AH liMADu CA) =0, Hr=>q, M 
a 
fim’AD,,(4) = miD tà) = limaD,,(A) =0, 
Akg " Ada Alo 


证 RGEC), FRR. Fee, Bi Vavi OL 而 由 Chung 
[1， 第 22 页 注 ]， 
Vet) VV YSN), 
于 是 


E+ l 
AGLA) ™ ` Vialà} SVE AAG CAVE CA). 
EE 


EET), AVEROO EAVES, ALO. Aili 
Lim AG aA) SVE MAGAV Es, l 


sim.) = 0. Fe (8) 得 证 引 理 ， 


引 理 》 设 AIH {QQ ,Cg，。)，4E wv} HH, by 
OCA) AB Pe a A PA) 

GQ) MRXI>O, Mawr wis, 

Gi) WEZ >0, 则 7 为 名 常 返 ， 

证 RANA, tr 为 第 np 个 飞 牙 点 、 册 一 阶 过 程 的 
结构 ， w(t" 0) S DAES HEALS BE. FA REE S| BE 
2.2, 

Pitcej}sPi{eose}=1, (9) 

& ¢,=0, Bo =t, OHS AX SBA, AES, GF 
的 第 一 个 飞 既 点 。 由 (9) RIB dA) RHE, Pi{6,<co} = Pi{f, 
<eo}=1, Led 后 首 回 i 的 时 刻 ，81 为 纪 后 的 第 一 个 飞跃 
庶 ， 则 可 证 Pi{5, 之 0 一 切 R} =1, | 

HAE = D = GF EFS, 1% 2,,,. 由 定理 6,7.3， 它 们 彼 


+ 34 0 


此 独立 。 由 强 马 氏 性 ， 
Pi {x( 8, ~ 0) =a} =P:{d,<l00o, Bs ,[a(t-0) =a]} =Xj >o, 
€10) 
Fk Borel-Cantalli5| 理 ， 
Piic(B,— 0) =al nAg Pl} = 1, 
ADEA | 
Pi X(T' 一 0) = oH LSP} 


= > Xi P(x- 0) = at ASM |a(r’—0) = 6} =1, 


AT oO, RP la(t'-0) =0 对 无 穷 多 个 Txtzt0)=Gy=T。 即 a 
为 六 常 返 ， 
O GD 癌 (让 ,代替 (1 站 的 是 Pi{2(B) =r} = Zi >00, WPi 
=" ABP =1, BA 
Piatt) = 对 无 穷 多 个 二 
= >) 2,.P {e(t') =r SAS Ppl late!) = 四 =1，。 
因 Zi 0, KPAI = BAS Meet) =r) =1， 即 7 为 名 党 
Ma, HEB, 
定理 3 dA (QO, Hla, +), GC xE, Dea) 
非常 返 。 
Ci) TAG) FBR BARE. FE, bE 书生 >o, 


Ai>0, Hr RE, Hab, 1) 
(ii) yp) Bg ESE SRE Er, QE AZ; > 


Z g(a} 
r==> qd >i, ry reek. 


证 REG), Æ D PAo 
limypiQ) = rar D D XiGaA} 
440 cea bh coe 

1) a, SARA, ase 
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二 了 ii 十 > GAS a (11) 
RPE * RANT IN TE ETT ORAM, Sate F BREAN 
(20) 步 到 2 的 概率 。 

WRAAE, ID BAARA, BRE, DE, 
EXIDO, Ga>O, Ai>O. W52, Ar iB. ign >0 正好 


maesb. 
HAERERE. MBE b, Woe=1, Garo, 


OD RAW WM. We, MTA Bob, M 
G0, WOW HIB, BIGy,=co, FRCL 右 方 也 为 无 穷 ， 证 
毕 。 

定理 4 PRI), SI DOE. BVO (0, 
Ris, +), eE x} Briu, 

GD) MOQ) HR. MSE 

QRT, £= 10iEE), Hla, E)=1, aE, (12) 
Hp = PHTY< eol 如 (2.3)。 

GD WRD R, MATERA., OA M, 
DAR E; Ox PH-PYRERE: DAp Aer RERS. 
Wp (A) Fe I 

证 (i》 由 引 理 2.3, &: =Pift<o} =1(iEE) H Pigs æj} 
=1。 由 此 得 必定 保守 。 于 是 对 6E ww， 由 (10.5.2), 


> Hoa, k)= X P{r(T) =EIz(t 0) =a} 
4 . a 


=P{r<o|x(t-0) =a} = P{r<eola(t—- 0) =a} =1, 
(ii) EdD 成 立 ， 并 在 定理 前 提 假 设 下 ， 必 定 X >o, Ai 
六 0 对 一 茹 9 Ew RM EERE, Hib EZ -0ON—WICERre 
ARIE, X 


« 366 « 


> Vie = 之 Fo k) DX} = Ho, KE. = 1, 


bg FE 


> Zra = 2x; DMa, G) = Sx: =, =l, 


所 以 如 果 @ 一 @ 中 之 一 成 立 ， 都 可 推 冉 有 a& AH WR M FS 
4 为 & 常 返 。 因 此 定理 3 的 充分 性 条 件 满足 ， 从 而 YO) AE, WE 
毕 。 

定理 5 RIWIMERE, VAHO, Ma, +), aE 一 
阶 过 程 。 设 0=supH(a，E)<<1， 则 i9YC%) 非 常 返 。 


证 ARB Aco, Al 
之 Xi Ae SKIS, 


few 


WAM 易 得 
A OSS Sac, Pusl, 
Å 


> Tot (Ad, S G4 AI< > d= 7i. 


bE F Ea }=Q 


出 (1) 得 
Palri +t SIX GEES or = 


ace i- 
HILEKO DEA., Ute, 
Blo RO) (0, Mae, -), ac) 一 阶 过 程 。 对 任 
PCA) 
wi, i<j, W 


Vii 
Toss 


2 
(i) WEN, E)>0, We >o, CE), 


i x 

(ii) 对 任意 r，dgE 4，r 一 >4， 

证 ”证 已 为 A) BERR. nii 66.7.7), BimiRFyOA) F. 
wi, $ 
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Hi =Pint<o}>o, (13) 
(i) HER, FEWN, DDO, WESC wy 存在 i 使 Xi >O. 
于 是 
PP 存在 1 lir- 0) =b]2(r' -0)= G} 
Mla, DuisXi >0, 


7 
Ba => b, WGI mA fE 
定理 7 BIA) (Q, Wa, 3), ac) 一 阶 过 程 。 对 任 
ACK) | r 
(i) MAA, We WAKMRBAHE 


N,=Eyt<coo, kA, (14) 
GD Meher Aa, MYOMA BAE te 
D> Ha, kN< cco, Er, (15) 
b 


证 只 证 G), (Gi WARE. Avia, 由 引 理 2,2， 
PAAR TH ST, BP 


A DY: (A)=1, iCE, (16) 
HVO THE GY EA, KOLAT, PES, AE TCA, rH 
SIR, HS6, AAS IER., BOO) 代入 (16) 并 注意 (1.5), 
DROP, ECA) = > XA), A 


aoa 


DXA DXA D Ma, MADOA) Di by (A), 


ei oa 了 .也 -时 


由 及 "A 的 线性 独立 性 ， 
1= 之 Ha, PADa) 之 和 4), aE, (17) 


Y gia 


(—) mB AGC ATEN, =, Heg, AEGEE » ENa, g) 
=O, R17), 
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iF (a, DAD Cr) > oy: Aal, 
i 


DO d 
Wa, a) > pa) 
i 
当 %40 时 得 jmXDs,(%) = 0, 由 引 理 1, 对 任意 +,49E 有 4， MAD, (A) 
=p TEH 及 4 的 有 限 性 ， 得 limay: (A) = 0， BIYO AN 
历 ， 


(Z) 设 对 一 切 foo。 厅 妨 设 对 一 切 r，9E A4， 
MAD OFE, 否则 可 用 子 列 代替 之 ， 册 (17) RAW - 


1= È Ma, r) MADA) ÈT, 
r gF JẸ i 


=> DAHta, r) InhD (OP aE 
410 


Os ae or, FE CE, r, qE AiE 
Hia, r) EMAD OOT g >00, 
Alo 


而 对 ceE .wx ， 必 容 在 i 使 X? >0。 于 是 由 (5)， 
m = limigu A) imz (AAD, (496,34) 
Aja AL 6 


>X, +) (limaD, 4) Tog >0. 


BPO iG, EAB, 
定理 8 HOSMER TMA ASR, “BAA 
Re., MEP DMOWRX EC or(QBEe {0, Hla, +), cE} 
一 阶 过 程 ， 其 中 
| P{e(t) =jl2(t—-O) sa} =H(a, 7), (18) 
ty + GRR. 
证 XC an, tk 
pis(t)=P{rtt)=), toc} + Pitt, x(t) =F} 
afi) > SPia(t-O)=a, txt, ra) k, 


Ex k 
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xC fF) =f} 
利用 强 马 氏 性 及 定理 6.17 ,1， 易 证 上 上 式 被 加 项 等 于 
| Pel — dP; = | pact- s)dPifece 
站 一 ü 
—Q)=a, x(r) =k, T8}, 
Piett-O =a, (r) =&,t<s} S Pert) = atas} 
a P{æ{T)=klzitr- 0) sa} Li aHa, &), 
#0019) FES 
Plt) = ft) + 之 2 Ha, k) [ou ~ sdl), 
Fe fi FO aE a 7B 
P= 30+ DS XA) D Ua, khpal. (20) 
a 后 时 A 
或 者 yh) = OCA) + (KOA) LBA}, (21) 
其 中 BUC) = Sta, Ry), AI LRN (G,+) 得 
A 
{BNI = LAA) + MOAN BAD, 
{E~ AHER = LAA) Ya (22) 
其 中 A 和 如 07)。 x ot RR 4.2), A BOA 


行 和 之 Dua, OXI, BAR, wi- RE 


而 且 等 于 多 (X)》 = Sead), WA), 


{BCA} = {~ MCA) HAO = PCA LAA) 
RACIMOS EAC), POI, Hla, +), 6.97} — 
阶 过 程 ， 证 毕 ， 

E 本 节 许 多 纤 果 可 推广 到 & 阶 瞬 返 过 程 ， 但 从 栈 ， 


$6. 双边 生 灭 过 程 


这 里 将 采用 第 四 章 的 记号 。 
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BEX ARG RG, THA RRR. RE (11.2.6) BE 
BAA AS: 
引 理 1 hi<k<a, 


Zu 号 


PEE} s-i, PAEA) ==, 《IT) 


i | 


证 ” 仿 定 理 11.2.2 证 明 . 
定理 2 用 Ci. 表示 外 从 k 出 发 经 有 窃 C0 ARR aA 
A, BIC,,=P.{é,<t}, pi] 


Cin 一 €2) 


证 ED PPB Sn + oi- co 而 得 。 
定理 3 ”最 小 9 过 程 常 返 的 充 要 条 件 是 ri 和 r。 芍 无穷 


证 ”因为 从 0 出 发 离开 0 后 又 回 到 0 的 概率 月 = —O— c_,, 


Gat’, 
— "9 C19, 由 (2) 可 见 /3 = PER Y o RIEN. 
定理 4 ke IJE A, MEH HERRIE 
SuL, C3) 
A 
而 且 此 时 
D ihe 
tii = k (4) 


| WM = (2 ~ ;2 > bs t > (Zm 2 i (5) 
Seat roger 


ig = > (Zs 27)Hs t (2; ~ 2) > ss PIPEN (6) 
Gr 


puns 
其 中 fi; = Eni PREG. TTNA E, 
» 37] œ» 


证 SRRAOH@NX=(2(t), too}, HRB RED 
Pini} = Pi {icol Be. Wi<k<n, wu, = min E, Ea) 
WEAS f0, fas lickcn) Rp R4.4.11), Hed (4.4.12) 
得 


Emin é; En) = 一 之 I -Zoa Z dn, 


站 
p> (T ZDRSA) y (7) 


A, 名 ,一 3; Hs, 
在 上 式 中 令 i 一 co， now + CoM HE Rr, "无穷 得 (5) (6), Ae 
ORT, 
1 


b; 
Hit =o me Li ta 4479 


注意 (zi 一 Zg) = 8254, ~ 24) =e, C5) (0) RAL Ae 
(4), 
引 理 5 ” 当 最 小 过 程 非常 返 时 ， 


N,=£,t = ŞA, a) IF, ZZ), 
Sah Fa — F: 


T 


E-P Fi Z9 
+ 之 For, . (3) 


证 在 (7) thie 一 一 co > + con. 

定理 6 Er MARHA. r PREM, WOO) Rie 
Hs RAR AA BVA) pE., 

证 ”本 定理 是 定理 4.2. 的 特 款 。 在 本 定理 假设 下 ，Xi = Xe, 
X$=Xi, C.DA REWER. U.D te = 0，X?” = 
X'=0, BUO.. DMB. 

定理 7 设 ? MARAH, r- MRE, POOR. W 

(i) Br MA. Ae. 

(ii) ir HA, 

© th>#=0, MOTRA. 


kE. 


© Wa>e<o, By) ARM.8.3), Wy) 


amo 
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的 充 取 条 性 是 


> aN, <, 《9) 
特别 地 ， 邵 果 D <0, Daz), TO 


证 在 (4.8.12) 中 令 xJ0 得 


m= P(r, 2) + Pih r ARP, = 0, r, 流出 时 
P,=0, (10) 
但 是 r: 正 则 或 流出 ， 而 且 
Dre peL, RA DeL rE). 
ine i-o 


(11) 
DS Too HPP, > os 注意 X =X? =1, Boa H 性 条 


PECL. DRY 


> aN, +P, Sy <oo, (12) 
T 站 过量 
国 为 由 定理 6 有 ? ,无穷 ， 攻 由 (3)， 
Ni= (ra= 2a) Dh + Cs ~ 2) (13) 
Aus fk 


TEE an > Bs < co， by 


rad 


S aN, (14) 
chk, 42 oy, 
N,= (rg, a) > eet Ma, (15) 
F-.0 


ERME. IIL 124 AUNs. ESRB 4.11. 9804.11.4, 
>, TN oo, 


| GQ 
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(i> Ber, 流入 ， ME a soo He (14)， 遍 历 性 等 


Fig 


WFG). 但 当 i<0 时 ， 由 (11)， 
Ne Drab +t D a — eB = aes — 2,8, Loo, 


Bt Fy EB 11.5, 
l SaN (Fa)( D odn) <e. 
720 iad 了 
BUVO FG 
(11) 设 r | 自然 ， 
O BDH, BADEN, =o, MBax0, M2) 不 


WE. WEa=0, WAP. >O, AMD wR ma, MAD 不 
WE. 
© 设 记 上 之 oo， 和 由 于 (14)， 遍历 性 条 件 (12) 成 为 (9)， 更 


gf <- 站 


说 > Gre ™ 2,)<oo, H13), Mists, 


<0 


N (Fr, ~ 2; ) Dae t > (he 2, 


bi + 


+t Oae ORE) De 
z.. Ü 


i. 


+ > (Fs Zot, 
t.: 0 


由 定理 4.11.5 有 之 ,< RA DAN <co, ARCS) Ls 
各 去 站 i= 
na | 
EES 设 r:，r: 正 则 或 流出 。 
(i》 OO RPO RRS ARSE AE, 
GD 不 中 断 台 过 程 必 遍历 ， 
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证 由 引 理 3.2，#(%) 常 返 必 不 中 断 ， 
首先 证 ， 如 04 衬 0 使 $C%)E1， 则 


> GN, oo, | (16) 
< 
其 中 心 k 根 据 (8) 确 定 。 当 Rs 关 0 时 ， 由 (8)， 
Nye (hy ~ Z) Seo" w+ My, (17) 
<0 Po“ Fy 


SO ATM BY (4.11.11 AUN, 由 定理 4.11,3 和 4,11.4, D Na 


ġa GO 
- 类似 证 D aN, 
[ ù 
HR, SEF (4.7.12) My), Shalom 
alanine 7 流出 时 已 = 0, (18) 
Wer, 正则 时 ， DX fess 一 -È 2; “fies Deco. A 
7 i=0 jag 
FE, Py 正则 时， Sx 因此 恒 有 
DLS, (19) 


_ 理光， 由 引 理 4.1， 
Cet, Xo XAJ OAC HCA), Xlo, (ALO, CO 
dn Bu AEMA.10.16)lc=0, di=d,). 由 (16) 19), 
HRT IOO REMAR, EA 
之 Pay + P Xin, +P, Xin; 


Ty = limb, 5(h) =-Ż e, 
2. aN, + >P, Xi tPF, Xi yey 


Cal) 


Hv) ARR (4, 10.1)(4.10.4) (4.10. 33) ,并 且 S13 
一 Stra, 


ic 
GH) = EI f+ Ht #7 


= 2 {FO} ‘diag (6 ). (22) 
Pipes :为 矩阵 多 一 F.-Y ER, (CX) = (fed), 
ab 
f(hy=0, JPA) =— (ba), (23) 
i-e; 


FH (20) 7% S" = 0 得 
1~—es’t1, feca>tS®, J0). (24) 


BFK INS, ALO, FOr DF 


iad 


WA) 可 以 写成 下 式 ， 
W = 6; (4) + EXN AMA), (23) 
ERA) = ghp) + MEX, rye HT Me = 0, (26) 


ae n JES) ADL ORPOAD BIER, BFPO) 不 中 断 ， 
ie 

AG (A) tA) = 1, a=1,2, (27) 
R16) CGA (19), ALOFT. 

Saat Si CaN, + MX in, <0, 

了 Å 
从 (27) 得 jimXGu(x) D n} = 1, Bo EMAGA} >0, 从 (25) 


得 
limay, DXi HMAGa CA) >0, 


Mimnv a wa, E, 
© 376° 


参考 x mR 


F FER 7 
C1 随和 机 过 程 论 ， 科 学 出 版 社 ， 北 京 ，1965， 
[2 2 生 严 过 程 种 蕊 尔 科 去 链 ， 科学 出 版 社 ， 北 京 ，1839， 
CS IER ih, BERR, §(1962), 137—187. 
£4 3The Martin boundary and limit Theorems for excessive 
function, scientia sinica (HAA), XIV, 8(1965),1118— 
1125, 
Co 146K aE a PE SS, 南开 大 学 学 报 《自然 科学 } 5:5 
(1964), 89—‘4d4, 
{630n distributions of functions of birth and death process- 
és and their applications in theory of queues, Scientia 
Sinica (hB) X12 €1961}, 160—170. 
C7 JKAaccnpuKayug BcexNpoleccon Da3MHOIRKEHHSE H THÕĊIH, 
Hayne Jlaknaget Bacite KON du3-MaremM. HAYRA, 4 
(1958), 19—25, 
CSISRPRHEWS SS, BW, 15 (1965), 342-353. 
[9] 常 返 马 民 和 过程 的 若干 性 质 ， 数 学 学 报 ，16 (1966), 166—178. 
Epiky ae 
Cl IPRA Kt, SOA, 21 (1973), 66—71. 
C 22 中断 上 举 灭 过程 构造 中 的 概率 分 析 方 法 ， 南 开 大 学 学 报 OS 然 科 
学 )，1979, 第 3 期 ，1 一 -32。 


Pp ARH 
I] 一 类 马 负 过程 的 一 般 表 达 式 ， 郑 州 天 学 学 报 ，2 41962), 17— 
23. 
Ris 


Cle, LATER i. NURI, 19610 
吴 立 德 


+ J77» 


L111 可 数 马 尔 科 去 过 各 的 妆 态 分 类 ,数学 学报 ，15 (1965), 32—41. 

CJF KURO RARER BN DS D’, 数学 学 报 ，13 
(1963), 86—93. 

i SRR 

[IJ 可 列 状 态 蕊 录 科 夫 链 可 加 证 男 前 某 些 概 限 定理 ， 南 开 大 学 SB 

《自然 科学 ]，5:5 (19643, 121—340. 
Ril HRD 

CLIM GM BOA BAAR, Meee, 16 (196s), 429 
—452, 

[2 -一 类 生 灭 过 程 ，15(1965)，9 一 31。 

[ 3 -关于 生 问 过 程 构造 论 的 注 记 ， 数 学 学报 ，15(1965)，173 一 187 ， 

CAI WS RTE ME BAM EKER Bee et 
je, 701964), 397—-424. | 

【5 3] 生 灭 过 程 的 性 质 ， 数 学 进展 ，9(1966)， 365—380. 

C6 3 双边 生 灭 进程 ， 南 开 大 学 学 报 (自然 科学 )，515(1t964)7，9 一 40。 

[C7] 可 天马 如 可 夫 过 程 的 如 变 挤 和 和 强 极限 ， 中 国 科 学 ,1979,9,835 一 
3d8。 

[8 可 列 马 所 过 程 的 下 变 措 ， 潭 淹 大 学 学 报 (BPH). 101978), 
29—43, | 

COI AGA RU 区 间 ， 潭 潭 大 学 学 报 《自然 科学 )，1979 
年 第 一 期 ，1 一 8 ,数学 年 刊 ， 1 《1980),131 一 133。 

[1 人 可 列 马 慌 这 程 的 强 极 腿 和 流入 分 解 ， 数 学 年 刊 ，1(1980),255 一 
260. 

C1 不 规则 可 列 马 民 过 程 的 状态 分 类 ， 数 学 学 报 ，23(1980)，583 一 
608, 

(DARN REA EAA Rae AeA Ost eB 
ede, ARGE H, (1980), 1105—1108 

DQE Sie, ARPERTRAA AR A We AE eF 
国 科学 3，1981，1440 一 1452， * 科 学 通报 ?，198?，198 一 200， 

CIV BRARAA BRANDES SS OD UD, WM k 
学 (自然 笠 学) 学 报 ，1983， 第 1 期 ，43 一 55， 第 二 期 ，43 一 55， 

[1 要 I 双 有 限 愉 过程 椅 造 论 的 福 记 ， 湘 潭 大 学 自然 科学 学 报 ，1984 征 第 


<- 373 >» 


18 
施 仁 杰 : 
CLIP WRASSE, HPA ERC BRA), 
5:5 (1964), 51—88. 


CIJA SRAM, ILRKS SR CARAS), 2 
(1965), 111—142. 
C2 IRS Pat eA Ie, BAAR. 16¢1966),150—165. 
CSI RRAW SRA AEC, ARAE HR, 1983. 
fe Hx GE a 
L 1IQHE RE HEE HHR, 201974), 115—1830. 
CIFRAT ASRA REIER BAPE. + BASE ,3¢1975), 
259—266. 
C37Q 过 程 的 唯一 性 淮 则 ， 湖 商科 技 出 版 社 ，13982， 
RIBS AA is 
CLIFF RAPA SRY RE, PSMA, thet, 1978. 
CIF KRAAS aA RM RARE PH EHH th, RSE SH, 19 
(1976), 239—262. 
ein. URES 
HBR ARE, MBAR, 1979. BRIG, E C., wR 
Bio, BEML, 1962, RHE. 
能 天国 
[C13 具有 密度 着 和 阵 介 的 马尔 科 夫 过 程 ， 北 京 工业 学 院 学 报 ,1(1980)， 
1 一 10。 
C23 <Q, b>) 过 程 ， 科 学 通报 。26(1981) ，446 一 447。 
[3 3 马尔 科 夫 链 的 构造 问题 。 
Chunrg, K. L., 
CiJMarkov Chains with Stationary Transition Probabilities, 
Springer-Verlag, i960, 
C230n the boundary theory for Markov chains, Acta. Math. 
410 (1963), 19-—-77, ibid 415(1966), 111—163. 
Cramer, H., 


+ 379 « 


Mathematical Methods of statistics, Ptincton University 
press, 1946. 
Doob, J. L., 
Cl Markov cheins-denumerable case, Tran. Amer. Math, 
58 (1945), 455—473. 
C2 )}Discrete potential theory and boundaries, J. of Math. 
and Mech.. 8 (19593, 433—458, 
CIStochastic processes, 1953. 
Ant, E. B. ; 
C 1 JMapkorckue nponecch, GuaMatru3, 1963. 
C2ISRKAALDBESEH. LMR, Beet, 1962. 
C21 patudanan Teopaa toa Maproscux mnpoueccos (AlueKnpem- 
HWA caua) YMH, 24. Bais. 2(146), 1969, 3—42. 
Feller, W., 
C1 )0On the Integro-differentiaf Eguations of purely Discon- 
tinuous Markoff process, Trans. Amer. Math. Soc., 48 
(19403, 488—515.ibid. , 5$(1945), 474. 
C 2 ] Boundaries induced by nonnegative Matrices., Trans. 
Amer. Math. Soc. , 83(1956), 19—54. 
C3)0n Boundaries and lateral Conditions for the Koimogos. 
roff differential equations, Ann. Math. , 65 (1957},527—- 
570. 
F 4 }Notes to my paper “On boundaries and lateral conditions 
for Kolmogorolf differential equations”, Ann. Math. , 68 
(1958), 735—T736. 
C5 }The birth and death processes. as diffusion processes, J. 
Math. pures appi., 9 (1959), 301—345, 
( 6JAn Introduction to Probability Theory and Its Applica- 
tions, Vol. 1 {1957}, vol. 2 (1971). 
Hardy, G. H., 
Divergent series, Oxford, 1949, 
Hunt, G. A., 


« 380 « 


Markoff Chains and Martin boundaries, Illinois Journal of 
Math. 4 (1960), 66—100. 
Kartin, 5. and McGregor, J. L. 
The classification of birth and death processes, Trans. Amer. 
Math. soc. 86 (1957), 366—400 
Kemeny, J.G., Snell, J. L. , Knapp, A. W., 
Denumerable Markov Chains, Princton, Toronto—-New york— 
London, 1966. 
Kendall, D. G., 
Hyperstonian spaces associated with Markov Chains, proc. 
London Math. Soc. 10 (1960), 67—87. 
Kolmogoroff, A. , 
Uber die analytischen Methoden in der wahrscheinlichkeits- 
Fechnung, Math. Ann., 104, 1931, 415—458. (APRC J 
附录 ， 
Kunita, H.; 
Applications of Martian boundaries to instantaneous return 
Markéy processes over a denumerable space, J. Math. Soc. 
Japan. 14 11962), 66-——100. 
Lamb, C. W., 
On the construction of certain transition function, Annals of 
Mathematical statistics, 42 {1971}, 439—450. 
Reuter, G. E. H., 
C1 ]Denumerable Markov processes and the Associated Semi- 
group on i, Acta. Math., 97 (1957), 1—46. 
C2 JDenumerable Markov Frocesses, II, J. London Math. Soc. , 
34(1959), 51-91. 
C3 iDenumetable Markov Processes, III, J. London Math. 
DOC., 37 (1862), 64—TS. 
C4 )Denumetable Markov Processes (EV), On C. T Hou's Uni- 
gueness Theorem for Q-Semigroups, Zs. Í. Wahrsch., 33 
(1976), 309-315. 


+ 387 « 


Rupurt, G. Miler, Jr., 
Stationarity equations in continuous time Markov chains, 
Trans. Amer. Math. Soc. 109 (15983), 35-44. 
Saks, S. | 
Theory of the integral, Warzawalwow, 1937. 
Watanabe, T., 
[1 Some topics related to Martin boundaries induced by 
countable Markoy processes, 3und session of J.S.1, 
1960. 
C270n the theory of Martin boundaries induced by countable 
Markov processes, Mem, coll. sci. Univ. kyoto, series. A, 
XXXILIH, Math. 1960, 39—108. 
Wilks, S.S., | 
Mathematical statistics, John wieley and sons, Inc. New 
York, London, 1962, 
Williams, D., 
p 1210n the construction problem for Markov chains, Zs. f. 
Wahrsch., 3 (1964), 227—246. § (1966), 299—299. 
C2arhe Q matrix problem, S'eminaire de Propabilites A, 
Lecture Notes in Mathematics 511, Springer, Berlin, . 
1976, 216-234, 


« 782 « 


Be 
Bag hs 
PERES 
Bat 
DARA 
广汉 一 
DH IEJ 
F~ 
DVERI NEH 
U ~ 
PS fF 
Min EM 
MEn FM 
h - $Ë 
i- RA 
K, 
(KBD 
(KF; 


1,2 


引 


QR tF ' 
One 
a SB Hw 
其 小 一 
UE Il 
(U) ABA 


YD 方程 组 


VRE 
广义 ~ 


. WER 


Py Fy E) 
2p, #p(Q) 
uy RCO) 
2 喘 象 

和 特征 测 诬 


一 至 三 划 


— br the 
~he ah F 
JL Ae 
原子 一 
完全 非 原子 ~ 
流出 的 一 
FR 
Oe (Martin) 
oe es 
本 质 一 


D REREH RHR RRELA 


1.8 
1.2 
Be. 
6.8 
9.2 

1.10 
1.10 
10.16 
10.17 
B.2 
6.6 

667 

6.19 

6.13 

10,14 


1.19 
ded 
6.2 
6.2 
6.2 
6.15 
6.15 
6.3 
6.3 
6.3 


+ 383 « 


流出 ~ 
消极 
马 时 

ARAE 
飞 联 点 
GK RIA 


四 至 五 划 


HB BBY ae 
中 断 位 势 
中 断 过 程 
互通 

分 解 定理 
AR AS i ie 
TENH 


Tehat Blackwell) 4ft 


a Fe 
正则 ~ 
流出 一 
流入 一 
自然 一 
原子 一 
原子 流出 ~ 
HTPR 

AF EERE 

右 连 续 性 


六 至 七 划 


过 程 

TRB R~ 
#2 ( Doob) 过程 
出 前 方程 组 
向 后 方程 组 

癌 后 不 等 式 组 


* 384+ 


6.12 
6.12 
6.6 
6.1 
6.48 
9.2 


HARRAH 1.7 
列 ( 行 ?协调 族 1.10 
AA RE daž 
aL tt BRE G.3 
极 小 一 6.3 
~ HGS WU 6.3 

一 的 马 训 表现 6.3 
zti RRE 8.3 
导出 过 程 6.9 
有 有限 流出 6.16 
FETE TE 1.9 
间断 点 9.2 

八 至 九 划 
构成 区 间 8.3 
范 条 件 1.8 
单 流出 2.2 
单 流入 ae | 
单 非 保 守 2.3 
Pee pi pl AE ES 6.3 
BERR Ja 6.3 
BEER SR 6.3 
BE AR as 6.3 
典范 过 程 6.6 
AER REA 19.8 
ba PL 10.9 
典范 过 程 6.6 
AR HE WE 6.il 
MENE 人 3 
HEA ic Reuter) 定理 3.4 
十 至 本 一 划 
流入 分 解 9.6 


流入 族 
特征 一 
dp Ri~ 
AR BY ~ 
一 的 Riesz 5} 
流出 族 
特征 测度 
特征 数列 
a2 H 
极 小 ~ 
完全 非 极 小 一 
i a 
预 解 过 程 
TEHE 
预 解 算 子 
a TH RL 
极 小 一 
完全 非 极 小 ~ 


1.11 
10.13 
feo 
10.15 
1.11 
1.11 
10.9 
14.6 
6.5 
6.5 
6.5 
6.2 
6.9 
1.8 
1.8 
6.3 
Ged 
6.3 


常 返 


推移 算 子 
七 一 至 十 三 沉 


通 近 链 


iB iit Beh ETE 


最 小 解 
it By 


i Eh PTE 


强 极限 
FHA 
ai Hi 
BERA 
fA HE 


BF Et 8 


PEHE 


十 四 斯 以 上 


6.2 
6.6 


10.9 
10.13 
1.9 
6.7 
6.6 
8.3 
2.3 
2eg 
6.8 
6.8 


§.2 


6.19 


+ 3845 。 


The Construction Theory 
of Denumerable 
Markov Processes 


XIANG-QUN YANG 
Xiangtan University, Hunan, 
People’s Republic of China 


With a Foreword by 
D. G. KENDALL 


HUNAN SCIENCE AND TECHNOLOGY 
PUBLISHING HOUSE 
Changsha 


JOHN WILEY & SONS 


Chichester > New York - Brisbane - Toronto . Singapore 


First published as Keliemaerkefuguochenggouzaolun 
by the Hunan Science and Technology Publishing House. Changsha. 


Copyright «> 1990 by John Wiley & Sons Ltd.. Baffins Lane. Chichester, 


West Sussex PO19 TUD, England, and Hunan Science and Technology 
Publishing House. No. 3 Zhan Lan Guan Road, Changsha, Hunan, 
People’s Republic of China 


All rights reserved. 


No part of this book may be reproduced by any means, 
or transmitted, or translated into a machine language 
without the written permission of the publisher. 


Other Wiley Editorial Offices 


John Wiley & Sons. Inc., 605 Third Avenue. 
New York, NY 10158-0012, USA 


Jacaranda Wiley Ltd, G.P.O. Box 859, Brisbane, 
Queensland 4001, Australia 


John Wiley & Sons (Canada) Ltd, 22 Worcester Road, 
Rexdale, Ontario M9W ILI, Canada 


John Wiley & Sons (SEA) Pte Ltd. 37 Jalan Pemimpin 05-04, 
Block B, Union Industrial Building, Singapore 2057 


Library of Congress Cataloging-in-Publication Data: 


Yang. Hsiang-ch‘ ün. 
[Ko lich Ma-erh-k‘ o-fu kuo ch‘ eng kou tsao iun. Engtish] 


The construction theory of denumerable Markov processes / Xiang 


-qun Yang ; with a foreword by D. G. Kendall. 
p- cm. 
Translation of: K‘ o lieh Ma-erh-k* o-fu kuo ch‘ eng kou tsao lun. 
Includes bibliograhical references. 
ISBN 0 471 92490 3 


1l. Markov processes. I. Title. 
QA274.7.Y3613 1990 A 
519.2' 33~.-de20 89~22671 


British Library Cataloguing in Publication Data: 


Yang, Xiang-qun 
The construction theory of denumerable Markov 
processes. 
1. Markov processes 
I. Title 
§19.2'33 


ISBN 0 47! 92490 3 


Typeset by Thomson Press (India) Ltd, New Delhi 
Printed and bound in Great Britain by 
Biddles Ltd, Guildford and King’s Lynn 


Contents 


Foreword to the English Edition 
Foreword to the Original Edition 
Preface to the English Edition 
Preface to the Second Edition 
Introduction 


Chapter 1 Theoretical Background 

1.1 Introduction 

1.2 Random processes 
1.2.1 Definitions 
1.2.2: Family of finite-dimensional distribution functions and existence theorem 
1.2.3 Separability 
1.2.4  Measurability 
1.2.5 Sample functions: continuity and step functions 
1.2.6 Classification 

1.3 Markov processes 
1.3.1 Definitions 
1.3.2 Transition functions and homogeneity 
1.3.3 Family of finite-dimensional distributions and existence theorem 
1.3.4 Semigroup property and Feller transition functions 
1.3.5 Strong Markov property 

1.4 Markov chains 
1.4.1 Definitions and transition matrices 
1.4.2 Classification of states 
1.4.3 Decomposition of the state space 

1.5 Denumerable Markov processes 
1.5.1 Definitions 
1.5.2 Properties of sample functions 
1.5.3 Canonical processes 
1.5.4 Special examples 


PART I GENERAL CONSTRUCTION THEORY 


Chapter 2 Introduction to Construction Theory 
2.1 Introduction 
22 Notation and definitions 


23 
23 


212 


CONTENTS 


The problem of construction 
Continuity 

Existence of Q matrices 
Differentiability 

The Kolmogorov equations 
Resolvent operators 

Feller’s existence theorem 
Properties of the minimal solution 
Exit family and entrance family 
General form of Q processes 


Chapter 3 Construction of Q Processes in Simple Cases 


3.1 
3.2 


3.3 
3.4 


Introduction 

Single exit case: construction of Q processes satisfying the backward 
equations 

Null exit case: construction of Q processes with one non-conservative state 
Single entrance case: construction of Q processes satisfying the forward 
equations 


Chapter 4 Uniqueness 


4.1 
42 
4.3 
44 


Introduction 

Uniqueness theorem: the system of backward equations 
Uniqueness theorem: the system of forward equations 
Criterion for uniqueness: the Hou-Reuter theorem 


PART IT CONSTRUCTION THEORY OF BIRTH- 
DEATH PROCESSES 


Chapter 5 Bilateral Birth-Death Processes 


5.1 
5.2 
5.3 


Introduction 

Natural scale and standard measure 

Classification of boundary points 

Second-order difference operator 

Solution of the equation Au — D,u* =0 

Minima} solution 

Several lemmas 

One of r, and r, is entrance or natural, the other is exit or regular 
Both r, and r, are regular or exit: linearly dependent case 
Both r, and r, are regular or exit: linearly independent case 
The condition that a@(A)e/ 


Chapter 6 Birth-Death Processes 


6.1 


Introduction 

Classification of boundary point and second-order difference operator 
Solution of the equation Au — D,u* =0 

Construction of the minima! solution 

Several lemmas 


26 
27 
31 
33 
40 
44 
50 
53 
57 
64 


67 
67 


67 
71 


75 


79 
79 
79 
80 
-8I 


87 
87 
87 
88 
89 
91 
97 
100 
105 
106 
108 
118 


122 


122 
123 
126 
128 
131 


6.6 
6.7 
6.8 


6.9 


CONTENTS 


Construction of the Q processes satisfying the backward equations 
Construction of the Q processes satisfying the forward equations 
Construction of the Q processes satisfying neither back ward nor forward 
equations 

The condition that adf{Ajel 


PART II MARTIN BOUNDARY AND ITS APPLICA- 
TION IN THE CONSTRUCTION THEORY 


Chapter 7 Martin Boundary and Q Processes 


7.1 
7.2 
7.3 


Introduction 

Markov chains 

Martin boundary theory 

7.3.1 Excessive function and excessive measure 

7.3.2 Density function of an excessive measure 

73.3 Martin kernel 

7.3.4 Martin boundary 

7.3.5 Distribution of ultimate states 

7.3.6 h-Chain and the Martin representation of an excessive function 
7.3.7 Essential Martin boundary 

7.3.8 Uniqueness of Martin representation 

7.3.9 Minimal excessive function 

7.3.10 Ultimate field and ultimate random variables 

7.3.11 Martin entrance boundary 

Probability representation of a stopping potential 

Sojourn solution, ultimate set, almost closed set and boundary 
Canonical process 

Probabilistic Q process 

Probabilistic minimal process 

Resolvent process and induced process 

Probability representation of the IIH4) potential 

4-Jmage and standard image 

Boundary of minimal Q process 

Probability representation of .4{ 

Atomic and non-atomic exit boundary of the minimal Q process 
Exiting almost closed set and the Blackwell decomposition of the minimal 
Q process 

The condition for finite exit 

A conditional independence theorem 

Further description of general Q processes 

Instantaneous return process and its boundary 


Chapter 8 Construction of Q Processes with Finite Non-conservative 
States and Finite Exit Boundary 


8.1 
8.2 
8.3 


Introduction 
Basic hypothesis and the condition satisfied by F*(A) 
Simplification of the problem 


Vil 
136 
137 


139 
145 


149 
149 
150 
154 
155 
158 
161 
163 
166 
168 
171 
175 
176 
177 
179 
179 
181 
183 
186 
188 
191 
194 
195 
198 
202 
203 


204 
205 
206 
209 
210 


213 
213 
213 
215 


viii CONTENTS 


8.4 General form of F°(2) 

8.5 Non-sticky case 

8.6 General construction 

8.7 Equivalent construction 

8.8 | Remarks on the construction of the non-bifinite Q process 


PART IV PATH STRUCTURE OF DENUMERABLE 
MARKOV PROCESSES 


Chapter 9 The W Transformation and Strong Limit 
9.1 Introduction 
92 Definition of W transformation 
9.3 Strong limit theorem 
9.3.1 In the case that X is a function 
9,3.2 In the case that X is a process 
9.4 The proof of Theorem 3.1 
9.5 Several lemmas 
9.6 Proof of the strong limit theorem 
9.7 Several kinds of special strong limit theorems 


Chapter 10 Leaping Interval and Entrance Decomposition 
10.1 Introduction 

10.2 Definition of leaping interval 

10.3 Leaping point and leaping interval 

10.4 Leaping interval and Kolmogorov equations 

10.5 The yg, transformation and its strong limit theorem 
10.6 Entrance decomposition of a process 

10.7 The yf, transformation and its strong limit theorem 


Chapter 11 Extension of Processes 

11.1 Introduction 

11.2 D-type extension 

11.3 D*-type extension 

11.4 Doob processes 

11.5 Generalized D-type extension 

11.6 Generalized D*-type extension 

11.7 Extension of instantaneous-return processes 

11.8 On non-sticky extensions 

11.9 Stochastic chains and characteristic measures 

11.10 Initial time and lifetime of approximating II-chains 
11.11 Imbedded chains 

11.12 © process on a measure space 

11.13 Approximating minimal Q processes 

11.14 Entrance families and approximating minimal processes 
11.18 Approximating minimal Q processes on a totally finite measure space 


218 
222 
226 
232 
234 


CONTENTS 


11.16 Path structure of non-sticky return processes: DV-type and (DV)*-type 
extensions 
11.17 Generalized DV-type and generalized (DV)*-type extensions 


PART V CONSTRUCTION THEORY OF BIRTH- 
DEATH PROCESSES: PROBABILITY METHOD 


Chapter 12 Probability Structure of Birth-Death Processes 
12.1 Introduction 

12.2 Probability explanation of the characteristic numbers 
12.3 An extended Dynkin lemma 

12.4 Recurrence and ergodic property of the honest process 
12.5 Two lemmas 

12.6 Characteristic sequence 

12.7 Probability structure of processes 

12.8 Summary 


Chapter 13 Relation Between Two Kinds of Construction Theories of 
Birth-Death Processes 

13.1 Introduction 

13.2 Corresponding theorems 

13.3 Properties of the process at the first leaping point 


PART VI PROPERTIES OF MARKOV PROCESSES 
RELATED TO CONSTRUCTION THEORY 


Chapter 14 Properties of Birth-Death Processes 
14.1 Introduction 

14.2 Some fine results of the minimal processes 
143 Invariant measures of the minimal processes 
14.4 Distribution of the first returning time 


Chapter 15 Recurrence and Ergodic Properties 
15.1 Introduction 

15.2 Two lemmas 

15.3 Doob processes 

15.4 Single exit processes 

15.5 First-order processes 

15.6 Bilateral birth-death processes 


References 


Index | 


333 
333 
333 
338 
339 
340 
342 
350 
355 


357 
357 
337 
359 


Foreword to the 
English Edition 


In this book my friend Xiang-qun Yang presents the theory of temporally-homo- _ 


geneous countable-state Markov chains developing in continuous time. Systems 
of this kind with a finite set of states have been studied for many years. Indeed, 
the second volume of Fréchet’s book on probability, published in 1938, gives 
a detailed treatment. The interest and difficulty both increase dramatically when 
the set of states becomes countably infinite. The first detailed theoretical 
treatments of this ‘infinite’ case were given in two papers published in 1951 and 
written by Kolmogorov and Lévy respectively, and these have subsequently 
generated an enormous literature. The book by Kai-lai Chung (1967) at once 
became the standard reference for the subject, but now it by no means covers 
all that has been done—even by Chung himself. 

In recent years mathematicians in the People’s Republic of China have taken 
up the subject with enthusiasm, and there are two especially strong centres of 
Markovian studies in the Province of Hunan in which Professor Yang 
lives—Xiangtan University (of which he is the President), and the Chinese 
Institute of Railways in Changsha (of which Professor Zhen-ting Hou is the 
Vice-President). 

David Williams and I, accompanied by Sheila Williams, spent two wecks at 
Xiangtan University in 1983. A few lines from my diary attempt to sketch the 
exotic environment. 

“Xiangtan University is set quite by itself on a plateau of red clay standing 
out in a vast landscape of rice fields. These are arranged in tiers so that the 
water flowing out of one field forms a source for the next, and if one follows 
the flow backwards then the system forks as the valleys fork in an complicated 
network —almost a branching process.... This was well shown when we visited 
and climbed (in a typhoon) the holy mountain Nan Yue. There the “branching 


process” ascends the mountain in a succession of ever-decreasing rice-fields 


(ultimately just of handkerchief size) until the forest takes over as a sort of Martin 
boundary.’ i 

Our task was to give two weeks of advanced lectures to a group of some 
forty Chinese probabilists drawn from widely different parts of the People’s 
Republic. I lectured on archaeological seriation, and on the statistical theory 
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of shape, both novel topics for that audience. David Williams was not so 
fortunate. He set out armed with his recently published and now famous book 
Diffusions, Markov Processes, and Martingales as a text, but was astonished to 
see the members of the audience pour into the lecture hall, each clutching a 
well-thumbed xerox copy of it. ‘What we want to know’, they said, ‘is what 
happens next’. So they received an impromptu and highly original set of lectures 
from him. 

That incident impressed in our minds how seriously mathematical probability 
is taken in China—dramatic advances in Markov chain theory are exactly what 
one would expect. And dramatic advances there have been. 

The present book first sets out the basic framework of the theory of such 
Markov chains, and then in the latter chapters develops more recent advanced 
work by Professor Yang himself and by some other Chinese writers. The author 
made his own translation into English, and in the earlier chapters this has been 
carefully checked by Professor G. E. H. Reuter whose own work forms a basis 
for much of the subsequent developments. But the latter chapters of the book 
are essentially as the author himself wrote them. 

The reader should be alerted to a special feature of Chinese mathematical 
writing in the English language. This arises from the fact that in different 
traditions there are different conventions about what must be mentioned, and 
what need not be mentioned. Anyone who has tried translating Chinese 
mathematics into English will have noticed this. Sometimes, for example, 
algebraic manipulations will be completely omitted when we would expect them 
to be included. Conversely, Chinese readers must find our own mathematical 
writing to be extraordinarily prolix, and packed with references to apparently 
irrelevant matters, such as cricket. Readers from both language traditions have 
to learn to expect and to be patient with this. It is tempting to enlarge on this 
theme, but I will stop here, and wish the reader an interesting journey. 


DAVID KENDALL 


Foreword to the 
Original Edition 


Markov processes occupy an extremely important position in random processes. 
The denumerable Markov processes form a very active and theoretically fairly 
complete branch of knowledge of Markov processes, which is universally 
applicable in many fields of science and technology. Quite a few famous 
probability scholars, such as A. N. Kolmogorov, J. L. Doob, W. Feller, K. L. 
Chung, etc., have done a lot of work in this area of knowledge for quite some 
time and have made important contributions. For more than two decades, 
Chinese workers engaged in probability theory have conducted extensive and 
profound studies on this subject. So far there have appeared three monographs 
published respectively under the following titles: Birth-Death Processes and 
Markov Chains, Homogeneous and Denumerable Markov Processes and 
Reversible Markov Processes. 

In 1958 Zi-kun Wang, Professor of Nankai University (now President of 
Beijing Normal University), began to publish his research results in this field. 
Then he, together with his students and colleagues, further probed and developed 
his studies on the subject. Because of their long, unremitting and painstaking 
efforts, they have achieved excellent results on several principal problems closely 
related to this subject. This book is a treatise by Professor Xiang-qun Yang. It 
gives a comprehensive summary of his research results on the construction 
theory of denumerable Markov processes, which he has studied for the past 20 
years. Some of the achievements contained in this book are made known for the 
first time. 

The construction problem is a central one in denumerable Markov processes. 
Xiang-qun Yang's researches are mainly concentrated on the construction of 
birth—death processes in construction theory, and of the Q processes with finite 
boundaries, on the probability method in the construction theory, and on the 
relationship between the probability method and the analytical method. For 
these aspects he has obtained very good results, which come up to the most 
advanced level in the world. 

Quite a number of people in the world have studied birth—death processes. 
S. Karlin gave the integral representation of the minimal solution. W. Feller 
constructed all birth-death processes by the analytical method, which satisfy 
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simultaneously the systems of both backward and forward equations. Zi-kun 
Wang succeeded in constructing all honest birth-death processes by means of 
the probability method. Xiang-qun Yang has constructed all the birth-death 
processes by using these two methods and, moreover, has meticulously 
investigated the properties of birth-death processes. Therefore, the construction 
problem of birth-death processes has bcen completely solved. 

The general construction problem of denumerable Markov processes is a 
very difficult one. In 1957 Feller constructed all Q processes satisfying the system 
of forward equations under the conditions that Q is conservative, finite exit and 
finite entrance. Latter, Xiang-qun Yang constructed all Q processes under the 
same conditions. D. Williams and Kai-Lai Chung derived all © processes 
respectively in the case that Q is conservative and finite exit. Xiang-qun Yang 
has recently made further advances on this problem. He has derived all Q 
processes under the more extensive conditions that the non-conservative state 
and exit boundary of Q are both finite. 

The two methods in the construction theory, i.e. the probability method and 
the analytical method, each have their own merits and demerits. By applying 
either of the two methods we should achieve certain results. But the results 
generated by these two methods are quite different in form. Xiang-qun Yang 
has found the relatonship between the two methods with regard to birth-death 
processes and combined these two kinds of results. Hence, he succeeds not only 
in giving a clear, definitive probability meaning to the results of analysis but 
also in expressing the probability results in equally concise forms. The work in 
this aspect pioneered by Xiang-qun Yang is to be further studied because it is 
a branch of knowledge with a broad, bright future for development. 

This book is not a simple collection of the author's research achievements, 
but a treatise in which his research results are elaborately put into good order 
and carefully compiled. I believe that the reader can read this book through 
without much difficulty and reach the forefront of research in this field if he or 
she has finished reading the first three chapters of the treatise entitled 
Birth- Death Processes and Markov Chains by Zi-kun Wang. Consequently, the 
publication of this work will certainly give an impetus to the development of 
probability theory in our country. 

At a time when this work is about to be published, I have expressed my 
views briefly on it. On account of my limited knowledge, my personal remarks 
cannot be without something inappropriate. Colleagues are sincerely requested 
to be kind enough to make comments or criticisms. 


ZHEN-TING Hou 
Changsha Railway Institute 
3 March, 1980 


Preface to the English Edition 


I feel greatly honoured and very happy that my treatise The Construction 
Theory of Denumerable Markov Processes is to be available outside China in 
the form of this English edition. Readers abroad wili be able to read the book 
and my research results on denumerable Markov processes will be introduced 
to the UK and the world. 

Comprehension of this book presupposes one being familiar with the basic 
knowledge of random processes and the fundamental theory of Markov chains, 
which can be found in the book Markov Chains with Stationary Transition 
Probabilities by K. L. Chung and in the treatise The Birth-Death Processes 
and Markov Chains by Zi-kun Wang and Xiang-qun. Yang. These two books 
were published by Springer-Verlag. For the readers’ convenience, to this English 
edition I have added a chapter entitled ‘Theoretical background’, most of which 
is devoted to an introduction to the basic concepts and fundamental conclusions 
of random processes and, especially, to these of Markov chains, which are 
necessary for reading this book. 

I sincerely thank Professor D. G. Kendall, who recommended my book to 
John Wiley & Sons Ltd. I am most grateful to John Wiley & Sons Ltd and to 
the Hunan Science and Technology Publishing House for having decided to 
publish the English edition of this book; likewise I would like to extend my 
heartfelt thanks to the Editor, Mrs Charlotte Farmer, and Associate Editor, 
Mr Hai-qing Hu, for their kind cooperation and great efforts. In particular, I 
feel very much indebted to Professor David Kendall, who has been kind enough 
to write a foreword to the English edition of this book. The first draft of the 
English version of this book was mainly done by Dr Shou-jun Luo and Mr 
Ying-qiu Li, and Madam Dong-ya Zou and Mr Wei-guo Tan translated the 
forward and introduction and some difficult paragraphs. Finally, the entire 
English manuscript was examined and approved by myself. Mrs Jun-fang Peng 
typed out the approved manuscript. Therefore, the English version of this book 
was born of joint efforts. To all those mentioned above, I would like to give 
my hearty thanks. 


XIANG-QUN YANG 
Xiangtan University 
February 1989 
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Preface to the Second Edition 


The second edition differs from the first one in that some major revisions and 
additions have been made in the following aspects: first, a concise proof of the 
uniqueness criterion is given; secondly, the theory of the Martin boundary is 
elaborated and verified, and therefore considerably enriched; thirdly, those 
sections about the construction of the bifinite (finite non-conservative and finite 
exit) Q processes are rewritten; fourthly, the approximating Markov chains 
and approximating minimal processes are supplemented, and DV-type and 
(DV)*-type extension processes and generalized DV-type and (DV)*-type 
extension processes are also supplemented. In addition, a large number of minor 
changes have been made. 

The book has been enthusiastically received and heartily supported by a good 
many colleagues, who have expressed their interest in it since its first edition 
came out in 1981. Thus, the author has been greatly encouraged. What is 
particularly exciting is that quite a number of colleagues have suggested valuable 
improvements. To all these colleagues I extend my hearty thanks. My heartfelt 
thanks also go to the Hunan Science and Technology Publishing House for 
offering me the opportunity of having the second edition of this book published. 


XIANG-QUN YANG 


Xiangtan University 
5 April 1984 
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Introduction 


This book is a summary of the research results of the author on the construction 
theory of denumerable Markov processes. With an introduction to the analytical 
basis of the construction theory in the first chapter, special topics are presented 
progressively. 

Construction theory is a central subject in the theory of Markov processes. 
It is aimed at constructing Markov processes on the basis of some known 
conditions. In other words, we describe the Markov processes one by one. Thus 
we can study the properties of each Markov process according to its general 
and specific characters. For example, by basing our approach on the 
construction theory, we may select with relative ease those processes possessing 
inversibility from the different types of constructed Markov processes just as 
does the author of the treatise entitled Inversible Markov Processes. 

Up to now there have been two methods for dealing with the construction. 
theory. One is the analytical method, and the other is the probability method 
(both of which have their merits and demerits), Certain results have been 
achieved by means of one or other of these two methods. We can find a brief 
account of this aspect in this book. 

The present work has six parts, basically dealing with three major aspects. 
In Parts I-III, the analytical method and results of the construction theory are 
discussed. In Parts IV and are expounded the probability method and results 
of the construction theory, and the relationship between these two methods. In 
Part VI a discussion is given on some properties of Markov processes related 
to the construction theory. Considerable importance is attached to the 
birth-death processes, not only because they have their own important 
theoretical significance and application value but also because they are often 
the source that gives the ideas and methods for solving general problems. ` 

The analytical basis of the construction theory is discussed in Part I. First, 
a study is made of the analytical propertis of the Q process as a transition 
probability, of the construction and properties of the minimal solution, and of 
the general form of the Q process; then Q processes in simple cases are directly 
constructed; finally, the uniqueness problem for the Q processes is discussed. 

Part II is devoted to an exposition of the construction theory of birth--death 
processes. We have succeeded in constructing all bilateral birth-death processes 
and all unilateral birth--death processes, the results being complete and 
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enlightening. A good grasp of the construction theory of birth-death processes 
is extremely conductive to a thorough understanding of the general construction 
of the Q processes. 

Part IH is concentrated on a study of the Martin boundary of Q processes and 
of its application in the construction theory. First of all, we apply the Martin 
boundary theory of discrete parameter Markov chains to the Q processes, 
conducting an extensive and profound discussion. Next we introduce the Martin 
exit boundary of the minimal Q process and further describe the general form 
of Q processes in the light of the exit boundary. Finally, we construct all the 
finite non-conservative and finite exit Q processes. That is to say, all the Q 
processes in the “double finite’ case are constructed. 

In Part IV emphasis is laid upon analysing the path structures of probabilistic 
Q processes. First the concepts of W transformation and strong limit are 
introduced. General Q processes can be changed into various processes with 
simpler path structures by W transformation. Thus it is convenient to study 
the paths of processes from various aspects. The strong limit theorems 
demonstrate that the paths of relatively complicated Q processes can be 
approached by those of Q processes with simpler structures. Secondly, the 
concept of leaping intervals is introduced to study the exit and entrance of Q 
processes. A discussion is given on how leaping intervals and leaping points 
are related to the system of Kolmogorov equations, and the entrance 
decomposition theorem is derived. 

Finally, the extension of processes is studied and the sample paths of processes 
with simpler structures are directly constructed. We mainly consider the D-type 
extension. In order that the Q matrix of the extension process remains 
unchanged, we also take into account the D*-type extension. 

Part V exclusively treats construction of the probability method for 
birth—-death processes. As these processes are particular, the results obtained 
are relatively profound. Each birth—death process is not only the strong limit 
of a sequence of Doob processes but also corresponds to a characteristic 
sequence. We have established the relations between the birth-death processes 
constructed by the analytical method and those constructed by the probability 
method, so that the processes constructed by the analytical method have clear 
probability structure and the processes constructed by the probability method 
have succinct analytical expression. In this way the virtues of each method can 
be brought out. With simultaneous use of the two methods, the results are more 
remarkable. 

In Part VI some properties of Markov processes, mainly recurrence and 
ergodic properties, are investigated. These properties depend closely on the 
construction theory. 

I extend my hearty thanks to my teacher, Professor Zi-kun Wang, for his 
patient guidance, without which it would have been impossible to attain these 
research results. I have also greatly benefited by numerous discussions with 
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Professor Zhen-ting Hou. Moreover, he has read through the manuscript of this 
book very carefully and suggested many valuable improvements. Among those 
who had discussions with me and rendered me much support and 
encouragement are Associate Professor Qing-feng Guo and colleagues Rong 
Wu, Wen-chuan Mo and Mu-fa Chen. To all these I express my sincere thanks. 


CHAPTER 1 


Theoretical Background 


1.1 INTRODUCTION 


A number of basic concepts and major conclusions of random processes and 
Markov chains are given briefly in this chapter, but the proofs of conclusions 
are omitted. These concepts and conclusions will be used often in this book.! 


1.2 RANDOM PROCESSES 


1.2.1 Definitions 


One or finitely many random trials are usually considered in elementary 
probability theory. These random trials can be described by one or finitely 
many random variables. In the law of large numbers and the central limit 
theorems, a sequence of random variables is involved, but it is assumed that 
the variables are independent. However, in practice, we have to study the 
development and process of a random phenomenon, and the events considered 
must be concerned with infinitely many (not necessarily denumerable) random 
variables. Consequently, we need to study all the random variables involved in 
the development and process of the random phenomenon. Thus we can depict 
the whole statistical law and the development of a random phenomenon. Hence 
we usually call a family of random variables a random process. 


Example I 


Let T = {1,2,...,N} or T = {0,1,2,...} and X(i) be a random variable for each 
ieT. Then X = {X(i), ie T} is just a random process. But at this time we call it 
a random vector or a random sequence. 


Example 2 
In order to investigate how much service is performed at a telephone service 
counter, we calculate it by starting from a certain time t = 0 and by letting X(t) 


‘A note on notation. ‘Equation (1) and ‘Theorem 1’, ‘equation (2.1) and ‘Theorem 2.1’, ‘equation 
(3.2. ly and ‘Theorem 3.2.1’, etc., refer respectively to equation (1) and Theorem 1 in the same section, 
in section 2 of the same chapter, and in section 2 of Chapter 3. 
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denote the number of telephone calls received at the service counter up to time 
t. Thus X = | X(t), te[0. x)} is a random process. 


Example 3 


When considering the storing capacity of a warehouse, we denote by X(t) the 
amount or quantity of some material stored in the warchouse at time t. Then 
(X(t, te[0, œ)} is a random process. 


Example 4 


When considering the problem of how far and wide an infectious disease has 
been spread, we use X(t) to denote the number of people suffering from the 
disease in some region at time t. Then {X(t} te[0, œ)} is a random process. 


Definition 1. Let a set T of parameters, a measurable space {E.:8}) and a 
probability space {Q, FZ, P) be given. For each teT, there exists a measurable 
mapping from (Q, 7) into (E, A} {the image of œ for the mapping X(t) is denoted 
by X(t,m)). Then {X(t)teT} is called a random process defined on the 
probability space (Q,.4, P) and taking values in (E, 4). l 

An element w of Q is called a sample point while an element of -F is called 
an event. The E or (E, #) is called the state space; an element of E is called a state. 


The parameter t is usually understood to stand for time; of course, the parameter 
t can also be understood to refer to something else, for instance the points in 
a plane or in a space. The state space (£,.4) is in general an abstract space. 
The one often used is (Eg, 45) or (R,,.#,), where Eo is a set of all non-negative 
integers, Zg is the Borel field composed of all subsets of Ep, R, =(— x, + œ) 
and #4, is the Borel field composed of all Borel sets in. R}. 


According to the definition of a random process, X(t,w) (teT, weQ) is a 


bivariate function taking values in E. When t is fixed, X(t.) is a random variable; 
when « is fixed, X(-,q) is a function defined on T, and is called the sample 
function or the path corresponding to the sample pojnt œ. 

From now on, if we make no special statement, (Q, 7, P) always refers to a 
complete probability space, i.e. a probability space with the property that any 
subset of a null-probability event is also an event. T always refers to {Q.1,2,...} 
or [0. oc); (E,.#) always refers to (Ey, Bq) or (R1,21). 


1.2.2 Family of finite-dimensional distribution 
functions and existence theorem 


Just as the probabilistic feature of a random variable is represented by the 
distributions of the random variable in elementary probability theory, so we 


RANDOM PROCESSES 3 


use the family of finite-dimensional distribution functions in the case of random 
processes. 


Definition 2. Let X = {X{f),teT} be a random process. For any positive integer 
n and teT, | <i<n, denote the n-dimensional joint distribution function of 
X(t,), X (ta)... X (tn) by Fy gs Le. 


F Ann d= PIX) <4, 1 Sin} AER, l<ign (i) 


fp.t2..-- 


af 


The family of distribution functions 
F={F tiET,l <isnn= 1,2,...} (2) 


is called a family of finite-dimensional distribution functions of the random 
process X. 


ey i ARNE 


Obviously, the family F of finite-dimensional distribution functions of a random 
process satisfies the following consistency conditions (a) and {b}: 


(a) Assume that (@,,@5,..., @,) is any permutation of (1,2,...,”). Then 
F Aise An =F, A 


(EA E eee tal me Ra Te een oe 
(b) Assume m < n. Then 


Theorem 1. Given a set T of parameters and a family (2) of finite-dimensional 
distribution functions satisfying the consistency conditions (a) and (b), then there 
exists a probability space (Q,.%,P) on which is defined a random process 
X ={X(t),teT} whose family of finite-dimensional distribution functions 
coincides with the given F. 


1.2.3 Separability 


In researching into random processes, non-denumerable union (Vv) and 
intersection {m) of events are often involved. For instance, sometimes we have 
to consider the set A of those sample points for which the corresponding sample 
functions of the random process X = {X(t),teT} are bounded by C in the 
interval [0, 1], ie. 


A = (w: X(C, w) is bounded by C in [0,1]}= Q {œX oC} (3) 
Ostel 
Although each {w:|X(t,@)|<CteF, the set A, as a non-denumerable 
intersection of sets of F, does not necessarily belong to F. Consequently we 
have to introduce the concept of separability. 
In the discussion of separability, we allow the random process to take the 
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value æ, but for each reT, 

P{X()= x%}=0 (4) 
Definition 3. A random process X = { X(t), teT} is called separable if there exist 
a denumerable dense subset R of T and a null-probability event N such that, 


for every wN, the sample function X(-,w) possesses the following property: 
for any te T there exists a sequence of points r, ER such that 


nom 


lim X(r,,@)} = X(t, w) (5) 


The set R is said to be'a separability set and the set N to be an exceptional 
set (relative to R). 
If the process is separable, then for the set A in (3),-the following holds: 
Ap DmADARONS 
where NS = Q—N and . 
Ag = {w: X(-,@) is bounded by C in [0, 1] mR)} 
= (\ {ar|X(r,@)|<CheF 


O€re1 
reR 


Since (Q, F, P) is complete, AeF. 
Definition 4. Let X ={X(t),teT} be a random process. If there exist a 


denumerable dense subset R of T and a null-probability œ set N, such that for 
any closed set A in [ — 00, + œ ] and any open interval /, the following holds: 


{w: X{r,w)eA,relR} — {w: X(t, w)eA,teIT}c N (6) 


then the process X is called separabie. 
Theorem 2. The two definitions in Definitions 3 and 4. are equivalent. 


In order to emphasize the separability set, we say that the separable process X 
is separable relative to R. If X is separable relative to any denumerabie dense 
set R of T, then X is called well separable. 


Definition 5. Two random processes X ={X(t),teT} and Y={Y(t),teT} 
defined on the same probability space (Q, Z, P) are said to be stochastically 
equivalent if, for any teT, it is true that 


PX = Y¥()}=1 


In that case, X is called a modification or a version of Y. 
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Theorem 3. Let X ={X(t),teT} be a real-valued random process. Then there 
always exists a separable process Y = { Y(t}, te T} stochastically equivalent to X. 


Y is called a separable version of X. Notice that Y take the value oo but 
PLY(t) = æ} =0, teT. 


Definition 6. A random process X ={X(t),teT} is called stochastically 
continuous if, for any toeT, we have 
P lim X(t) = X (to) (7) 
t>to 


Here the limit is the limit in probability. 


Theorem 4. Assume that a separable process X is stochastically continuous; 
then X is well separable. 


1.2.4 Measurability 


In order to study the measurability of a sample function X(-,@), we need to 
define measurable random processes. 

Let T = (0, œ), 2, be the Borel field composed of all Borel sets in T, L be 
the Lebesgue measure on +, p= L xP be the product measure defined on 


By, x F and Br x F be the completion of # x F relative to p. 


Definition 7. A random process X = { X(t),teT} is called Borel-measurable if, 
for any ceR,, we have 


{(t,a@): X(t,@) <che By x F (8) 
X is called measurable if, for any ceR,, we have 

{(t,w): X(t,@) <cleBy, x F. (9) 
Theorem 5. A right-continuous process {i.e. a process whose sample functions 


are all right-continuous) is Borel-measurable. A process almost all of whose 
sample functions are right-continuous is measurable. 


Theorem 6. A stochastically continuous process must have a measurable 
version. 


1.2.5 Sample functions: continuity and step functions 


Theorem 7. Let X = { X(t), te[a,b]} be a separable random process. Assume 
that there exist three real numbers a > 0, £ > 0 and c > 0 such that for arbitrary 
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teļa, b], + Ae[a,h], we have 
EIXU + A)— X(N Ss elal? (10) 


Then almost all sample functions of {X(, teļa, b]} are continuous. 


Definition 8. Let {X(t),te[a,b]} be a real-valued function, and suppose that 
there is a finite subdivision a = tọ < t; <---<t,=b such that 


(i) X(t) =c; for t;<t<1t;,,,i=0,1,...,n2—1, so that the limits X(t; -O)=c;_, 
(0<i<n) and X(t; + 0)=c, (0<i <n) exist. 


(ii) Either X (¢;) = X(t; — 0) (0 <i <n), in which case X(-) is left-continuous on 
(a,b], or X(t) = X(t; + 0) (0 <i < n), in which case X(-) is right-continuous 
on {a, b). 


Then {X(t), te[a,b]} is said to be a step function defined on [a,b]; if 
X(t; — 0) # X(t; + 0), we call t; a jumping point. 

A function { X(t), te[0, oc)} is called a step function if {X(1), te[0, b,]} is step 
function for a sequence b, fc. | ; 


Theorem 8. Let {X(t),te[a,b]} be a separable random process. If there exists 
a constant ¢ 20 such that, for arbitrary te[a,b], t+ Ae[a,b], the following 
holds: 

P{X a ZX} <clAl (11) 


then almost all sample functions of {X{t), te[a, b]} are step functions. 


1.2.6 Classification 


According to whether the set T of parameters and the state space E are 
denumerable or not, we can simply classify random processes into four classes: 


(i) T and E are denumerable; 

(ii) T is denumerable whereas E is not; 
(iit) T and E are not denumerable at all; 
(iv) T is not denumerable, but E is. 


A random process with a denumerable set of parameters is called a random 
sequence or a time series. A random process with a denumerable state space is 
called a denumerable process. 

The classifications above are only in form. They are not concerned with the 
inherent probability relation of a random process. If we classify random 
processes according to the inherent probability relation of a process, then a lot 
of important classes of processes can be obtained. For example, consider the 
following. 
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Definition 9. Let X(t)teT, be independent random variables. Then X = 
{X(t),t€T} is said to be an independent process. 
Definition 10. Suppose that, for arbitrary t,eT, t+t,eT, 1<i<n, 


X{t1), X(t2),-..,X(t,) 
and 
X(t, +0), X(t, + t),..., X(t, +t) 


have the same joint distribution function. Then the random process 
X = {X(t),teT} is called stationary. 


An cxtremely important class of random processes is that of Markov processes, 
which will be introduced below. 


1.3 MARKOV PROCESSES 


1.3.1 Definitions 


The intrinsic probability structure of an independent random process is simple. 
Let T = [0, œ); the parameter is understood as time, and X(t) is understood as 
the position of a particle making stochastic movement at time t. We consider 
the time s as the ‘present’; then the time interval [0, s} is the ‘past’, and the time 
interval {s, cc) is the ‘future’. Suppose that we want to predict the ‘future’ of the 
random process if we have information about the ‘past’ and the ‘present’, or 
about the ‘present’, or know nothing about the ‘past’ and ‘present’. For an 
independent process, the results predictable are the same in the three cases 
above. But for a Markov process, the result predictable are the same in the 
first and second cases above; roughly speaking, under the condition that the 
‘present’ is known, the ‘future’ and the ‘past’ are conditionally independent. 
This property is said to be the Markov property. 

Examples in reality possessing the Markov property are numerous. For 
instance, if we leave out secondary factors, population growth is characterized 
by the Markov property. The number of a population in future is relative only 
to the present population base and not relative to the number of people in the 
past. The process in example 2 in section 1.2 is also characterized by the Markov 
property. 


Definition 1. A random process X = {X(t),teT} is called a Markov process if, 
for arbitrary 0<1, <t; <- <t, and Teg, we have 


PEX(t)ET|X(t,),--05 X(t 0)} = PX (t EF X(t, 1)} ae. (1) 


The property (1) is called the Markov property. The Markov property has 
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many equivalent forms. For instance: 
(a) For arbitrary Os s st, Pe, 
P{X(theD|X(w,0 <u <s} = P{(heT|X(s)} a.e. {2) 


(b) For arbitrary 0 < s < t, and Ns-measurable random variable y, Eln| < œ, 


E{n|X(u} 0 <u <s} = En X(s)} a.e. (3). 


where N° = g{X(u), u > s} is the Borel field generated by {X (u), u > st. 


1.3.2 Transition functions and homogeneity 


Definition 5. A Markov process {X (t), te T} is called homogeneous if there exists 
a regular transition probability function (simply, transition function) if the 
following four conditions are satisfied: 


(i) for fixed s, x,t, P{s,x;t,-) is a probability measure on 2; 
(ii) for fixed s,t, I, P(s,-;t,°) is a -measurable function; 
(iii) for any seT 
P(s,x;s, F} = I(x) (4) 
where Ir is the indicator of T; l 
(iv) the Chapman-Kolmogorov equation holds: for arbitrary O<s<t<u, 
there is : 
P(s,x;u,T)= | Pls, xt, dy) P(t, yu, T) (5) 
E 


The condition (iii) is called the regularity condition. 


Definition 3. A transition function P(s, x;t, T} is said to be homogeneous if for 
fixed x and F the values of the function only depend on t—s. That is, there 
exists a three-variate function P(t, x, C} such that 


P(s,x;t,T) = P(t —s,x,T) (6) 
In that case (i) (iv) in Definition 2 become: 
(a) for fixed t and x, P(t, x,:) is a probability measure on 2; 
(b) for fixed 1 and F, P(t,-, T) is a @-measurable function; 
(c) P(O, x, T} = {r(x); 
(d) for arbitrary s,t > 0, we have 


Pl(s + t,x,T)= | P(s,x,dy)P(t, y, E) (7) 
E 


The three-variate function P(t,x,F) satisfying {a)-(d) above is said to be a 
homogeneous transition functions. 
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Example | 
(Wiener transition function). 
— 2 
P(t, x, D) =< oat}? Jr 20°t 
AJE) t=0 


Here o > 0 is a constant. 


Example 2 


(Poisson transition function). Let E = {0,1,2,...}. Put 


a j-i 
U fr> 0 j > 
pu = 40-2 
0 ift>O,j<i 
Here A> 0 is a constant. And then set 
P(t,i,T) = ¥° pij(t) t>0 
jel 


Definition 4. A Markov process is said to have a transition function if there 
exists a transition function P(s, x;t, I") such that 


P{X(t)eT| X(s)} = Pls, X(s);t, T} a.e. (8) 

Definition 5. A Markov process { X(t), te T} is called homogeneous if there exists 
a homogeneous transition function P(t, x, I") such that 

P{X(s+ tel |X(s)} = P{t, X(s), r} a.e. (9) 


1.3.3 Family of finite-dimensional distributions and existence theorem 


Theorem 1. Let {X(t),teT} be a random process. In order that {X(t),teT} is a 
homogeneous Markov process, it is necessary and sufficient that there exists a 
homogeneous transition function P(t, x, T) such that for anyO<t, <t, <e <t, 
and T;e4, 1 <i<n, the finite-dimensional distributions are given by 


P(X (ter, | <i< n) 


-Í mavo | Pawyody) | P(t, 一 turned | Pita — fi 1 Yn- OV 
E Ti T2 n 

(10) 
where (T) = P(X(O}eT) is the initial distribution. 


Sana, litte Sea Pe Fite ES ai ae Sth Wee 


a 
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Theorem 2 {Existence theorem). Let a homogeneous transition function 
P(t,x,F), t 20. xeER,, Te#,, and a probability measure p(T), eg, be given. 
Then there exists a probability space (Q,.7,P) on which is defined a 
homogeneous Markov process {X(t),t = 0} with the given transition function 
P(t,x,F) and the given initial distribution {F). 


1.3.4 Semigroup property and Feller transition functions 


Let B be the collection of all bounded -measurable functions defined on E. 


For f eB we define a norm || f || = sup,_,| J (x)|. Then B is a Banach space. For- 
feB we define a function by 


T, f(x) -| F(y)P(t, x, dy) (11) 
E ; 


Obviously, T, f €B, and moreover, from (a) and (b) for a homogeneous transition 
function (Definition 3) we have 


ITIS T= 7,7, (12) 


S 

That is, {Tt > 0} is a family of contraction operators, forming a semigroup. 
Whence we can determine its strong (or weak) infinitesimal operator A (or A) 
and strong (or weak) resolvent operators R, (or R,), 4 > 0. Therefore we may 
research into the tansition function of Markov processes by means of the theory 
of semigroups in functional analysis. 

Assume that the state space E is endowed with a topology and C denotes 
the collection of all bounded continuous functions defined on E. If T,f eC for 
any f eC, the transition function is called the Feller transition function. 


1.3.5 Strong Markov property 
Definition 6. Let X ={X(t,teT} be a random process. We say that X is 
progressively measurable if, for any teT and Te», it is valid that 

{(s, woF 0 Ss <t, X(s, oer SEB, x N, (13) 
where 2o, is the Borel field composed of all Borel sets in [0,1] T, and N, is 
the Borel field generated by { X(s),0<s < t, se T}, which is called the pre-t field. 


Theorem 3. A random process whose sample functions all are right- (or left-) 
continuous is progressively measurable. 


Definition 7. Let t be a non-negative (including + co) #-measurable function 
defined on Q. If for any teT the following holds: 


(rgDeN, oe (14) 


一 -os o tet 
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t is called a stopping time of the process {X(t} reT}. For a stopping time 7, 
the Borel field 


N,={A:Ae¥, and moreover, AN(t < the N, for cach t> 0} (15) 
is called the pre-r field. 
Definition 8. Let X = {X(t),teT} be a homogeneous Markov process. Assume 


that X is progressively measurable, and moreover, for any stopping time z, it 
is valid that 


P{X(t + HeD|N,} = Pt, X(7),T) ae. Q, (16) 


where a.e. Q, indicates that it is valid for almost all weQ, =(t < x). X is called 
a strong Markov process and (16) is said to be the strong Markov property. 


Theorem 4. A homogeneous Markov process X ={X(n), n=0,1,2,...} 
possesses the strong Markov property. 


Theorem 5. A right-continuous Feller process is a strong Markov process. 


1.4 MARKOV CHAINS 


1.4.1 Definitions and transition matrices 


A homogencous Markov chain is a special homogeneous Markov process. When 


. T={0,1,2,...} and E is denumerable, we might as well set E = {0,1,2,...}, a 


homogeneous Markov process is said to be a homogeneous Markov chain, 
which is called a Markov chain for short. Of course, we can define a Markov 
chain directly. 


Definition 1. {X(n),n =0,1,2,...} is called a Markov chain if, for arbitrary m > 0, 
1 > 0, io losim- p i JEE, the following equality holds: 


P{X(m +n) = j|X(O) = ig, X(I) =i),...,X(m— 1) =i,,- Xm =i} 
= P{X(m+n)}= j|X(m) = i} 


and moreover, the right side is independent of m, provided the conditional 
probability is defined. 

We may as well assume that for each ie F, there exists a parameter meT 
such that P{X(m) = i} > 0. Otherwise, i is a non-essential state and i may be 
combed out of E. We can consider the state space E — {i} instead of E. 

Denote the right in (1) by ae which is called the n-step transition probability 
from i to j. The matrix P™ = (pi, i, je E) is called the n-step transition matrix. 
When n= 1, we write P = P, pj = pt’. The matrix P is called the transition 
matrix of the chain. Owing to the Chapman: Kolmogorov equations, it follows 


(1) 
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that 
pin = pr (2) 


Consequently, the transition law of the Markov chain is determined by its 
one-step transition matrix. Therefore, sometimes we call P the Markov chain. 
For a Markov chain {X(n), n=0,1,2,...!, the distribution y= (y,), where 
yı = P(X(0) = i}, is called the initial distribution of the chain. Moreover, the 
family of distributions 
P(X(0) = io, X(1) = i), ..., X(n) = in) = YP 
and the family of finite-dimensional distributions 


P(X (n) = i), X(n) = iz., X(n) = i), 


eP haio igs fy... EE 


ioii 


Ay << ees < Mps 


are determined by the initial distribution and the transition . matrix P. 


Conversely, given a distribution y = (y;) and a nonnegative matrix P = (P;;) with 
2; P = 1 for every i, by the existence theorem, there exists a probability space 
{0, FZ, P), on which is defined a Markov chain {X(n), n>0}. This chain has 
the initial distribution y =(y,) and transition matrix P = (P;). The probability 
measure P depends on the initial distribution y = (7;), and we also denote it by 
P, instead of the probability measure P. The measure P, is said to be the 
measure generated by the initial distribution y = (y;) and the matrix P = {P;;). 
When 7,;= 1, y;=0 (j 41), we denote it by p,=p,. For general y we have 
Py = DaYiPr 


Example I 


(Random Walk). Assume that Z(0)=0 is a constant, Z(i) (i= 1;2,...) are 
independent and of identical distribution, and, moreover, 
P{Z() =1} =p P{Z(i)= —l}=4q P(Z(i)=0}=r 
put 
p+q+r=! O<r<l. 


O<p, 0<4q, 


X(n) = ZO+ Z(t) + + Zn) 


Then {X(n}, n=0,1,2,...} is a Markov chain, its state space is {---, —2, — 1, 
Q, 1, 2,...$, and its transition probabilities are 


Posi =P Pii- =4 


walk when r =0 and p=q =}. 


The example above can be explained intuitively as follows. A particle moves 
stochastically in a number axis. It starts from the origin. Then it moves once 
per unit time. It shifts a unit distance either towards the left with probability 


Pi=r (3) 


{X(n),n =0,1,2,...} is called a simple random walk, and a symmetric random 


PINES RARE OE EI TE S Te re 
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q or towards the right with probability p; it may stand still with probability r. 
X(n) denotes the position of the particle after it has moved n times. 


Example 2 


(Random walk with barriers). Let the state space be {0, !,2,...,b}. Where the 
particle is at i (0 <i < b), it makes the simple random walk. Let the particle be 
at 0. If the particle goes to 1 after unit time with probability 1, i.e. po, = 1, the 
barrier 0 is called a reflecting barrier; if the particle stays at 0 after unit time 
with probability 1, then 0 is called an absorbing barrier. If the particle stays at 
0 with probability ro (0 < ro < 1) and goes to 1 with probability po = 1 — ro, the 
barrier 0 is called an elastic barrier. If we place variously different barriers on 
0 and b, we will obtain variously different random walks. For instance, the matrix 


100 -. 0 0 90 
qrp- 0 0 0 
2i eee 
0 0 0 -- gor p 
000.. 0 1 0 


represents a random walk with an absorbing barrier 0 and a reflecting barrier b. 


Example 3 


(Biological chains). Let the state space be {0,1,2,...}. If the particle is at i, when 
the particle walks stochastically to the left or to the right, or stands motionless 


-its probabilities are related to the position i. For example, the probabilities are 


Gs Poli Git Pi + ti = 1, do = 90, respectively, that is, 


ro 1 一 ro 0 0 
gı 1—(pi +4) Pi 0 
P=| 0 q2 1 — (pz + 42) P2 


0 0 q3 1 — (ps +43) 


A chain with the transition matrix P above is called a birth—-death chain. The 
intuitive meaning goes as follows: 

Assume that there is a biological group, the number of whose individuals 1s 
changeable. Suppose that at time n the number of individuals of the group is 
denoted by i. Then at time n+ 1, the biological group increases to i+ 1 
individuals with probability p; reduces to i~ 1 individuals with probability q; 
and keeps i individuals with probability r;. 


Feo Te 
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1.4.2 Classification of states 


Let P=(p;,ijeh) be the transition matrix of a Markov chain {X(n), n= 0. 
Lee ace 


Defintion 2. Assume that the state i is fixed and the set {n:n > 1, pit" >0} is 
non-empty. Let d = d(i) be the greatest common divisor of the set. The number 
d is called the period of the state i. The state i is called periodic when d > | 
and is non-periodic when d = l. 
Let t = t(j) denote the first time of reaching the state j: 
a >1:X(n) =j} if the set is non-empty 
t= 
十 CC otherwise 
Then 
Sp = P{t =ni X(0) = i} n:l 


is the probability that the Markov chain will first visit the state j at time n, 
given that it starts from state i. Furthermore, 
+. Spm 
Ii E 2 fa 
a=1 
is the probability that the Markov chain will first visit the state j after finitely 
many steps, given that it starts from the state i, and 
j=} nfi 
n=1 


is the mean number of steps that the Markov chain visits j first, given that it 
Starts from state i. Write f+ =f ¥, Į; = Hi : 


Definition 3. (a) The state i is called recurrent if f* = 1 and transient if f* < 1. 
{b) Let the state i be recurrent. The state i is called posttive-recurrent if p; < oo 
and nuil-recurrent ifp; = 2%. {c) The state i is said to be ergodic if it is non-periodic 
and positive-recurrent. 
Theorem 1. For arbitrary i,jeE and n È 1, it is true that. 

pk "Spt pink 

peo ‘(kb (mn 一 — “(HC— 
tp =} pare 
k=1 k=0 
MMS 40) a 

where Pij =ð SG; = |, 


Set 
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Theorem 2. It is true that 
Gii = i —/*) 
Gij=f 50 (i #j) 


Theorem 3. For the state i to be recurrent it is necessary and sufficient that 
Gii = 0. 


Theorem 4. Let the state i be recurrent. 
(a) iis null-recurrent if and only if lim,..,, pp = 9. 


(b) i is ergodic if and only if lim, ..,, pP = 1/4; > 0. 


1.4.3 Decomposition of the state space 


Definition 4. We say that the state i leads to the state j if there exists an integer 
n> 1 such that pi? > 0. In this case we write ij. Also we write iej to mean 
that i and j communicate, i.e. ij and ji. 


Definition 5. A subset C of E is called closed if for any ieC and KEC it is true 
that pi = 0. If two arbitrary states in a closed set C communicate, the set C is 
called an irreducible closed set. 


Theorem 5 (Decomposition theorem). The state space has a unique 
decomposition 


E = EU X E 


aE 


where .% is empty, or the finite set {1,2,...,b}, or the denumerable set {1,2,3,...!; 
Eo is the set if all transient states, which may be empty; for each ae., E, is a 


‘irreducible and recurrent class; the states in E, are all nuli, or all positive, or 


all ergodic; finally, all E,, ae{0} o., are mutually disjoint. 
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1.5.1 Definitions 


A denumerable Markov process is a Markov process with a continuous time 
and a discrete state space. We usually take T = [0, oc), € = {0, 1,2,...}. 


Definition 1. Let the state space E of the random process X = { X(t), t> 0} be 
denumerable. X is said to be a Markov process if for arbitrary n>, 


Ta 
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Ot, < <t,<s<4,i,,...,1, bEE, we have 
PIX(s +) =j| X(t) =i,,....X(t,) =i, X(9) =i} = PLX(st+N=s|X()=72 (1) 
provided that 
P{X(t,)=i,,....X(t,) = i X(s) = ik > 0 


If the right side of (1) depends on only t— s and does not depend on s, the 
Markov process X is called homogeneous, or a denumerabie Markov process. 


Denoting the right side of (1) by p,,(s,t), then the matrices P(s, t) = {pi(s, t), 
ijeE}, O<s<t, are called the transition matrices of X. Write E,(s}= 
{k:P{X(s)=k}>0}, Eo(s}= E—E,(s). If E,(s}=E for each s>0, then the 
transition matrices {P{s,t), O<s<t} of X exist, and satisfy the following 
conditions: 


(a) pis, 0) 20 2, p;;{s,t)= 1 


(b) pals, t) = 2 Pils, «py (us, t) O<s<uxt 
k 


(c) pij(s, $) = oF 


But if E.(s)4 E for some s, p;{s,t) is defined for ic E ,(s) and undefined for 
icE gis). Does X possess the transition matrices satisfying the above condition 


{a}, Uo), (c) in the general case? The books that 1 have read affirm the truth of 
the conclusion but the proof is not given. My postgraduate student Yu-Quan 
Xie gives a proof of this below. 


Theorem 1. Each Markov process X possesses the transition matrices P(s, £) 
satisfying the above conditions (a), (b), (cj such that when ie £,(s), the right 
side of (1) is pi;{s, t). 


Proof. For ieE,(s}, we define p;;(s,t) by the right side of (1). 
Let ieEo(s). Take arbitrary non-negative numbers uj(s) (jeE) such that 
ui s) = 0 for je Eo(s) and Ð jer, ¥ij(S) = 1. Set 


pij(s,t) = >. Ui(S) Px ;(S, t} | O<s<t> (2) 

keE + (s) 
By a direct verification, it easily follows that P(s, t) = {p,,(s,t), i,jeE}, O<s <t, 
are just what we want. QED 


In the following X is always assumed to be a homogeneous denumerable 
Markov process. Then p;;(s, t) = p;;(t — s) is independent of s, and moreover, (a), 
(b), (c) become 


AA ATCT I ANTE A ge Tp eine 
Ty ai 
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(B) Puls +t) = ¥ pls) p,;(t) 
k 
(7) pij(0) = bi; 
Furthermore, we assume the condition of standardness: 


(6) lim p,,(t) = pi(0) 
1,0 


1.5.2 Properties of sample functions 
A family of matrices P(t) = {p;;(t), i jeE}, t 2 0, satisfying the above conditions 
(x)-(ò) are called standard transition matrices. 


Theorem 2. For standard transition matrices there exist right derivatives at 
t=0, 


pj; (t) — p;;(0) 


qi = pi,(0) = lim 3) 
140 t 
and moreover, 
O< qy <0 (i#)) 0g—gqgig% 
2 qj < du (4) 
| i#i 
A .” From (3) it follows that 

pit) = qt + oft) ixj (5) 

if q; < œ then 
pult) = 1 — qit + oft) (6) 


The matrix Q = (q; i, JEE) is called the Q matrix of the process X or of the 
transition matrix. It can be seen from (3) that Q is determined by the values of 
P(t} in a small interval [0.¢). In practice Q is easier to calculate than P(t). 
Therefore how to calculate from Q constitutes the central problem discussed 


EF - in this book, that is, the construction probiem. 


Definition 2. Write q; = — qu. The state i is said to be stable if q; < œ, to be 
absorbing if q; = 0, and to be instaneous if q= + oo. 


Notice that X(t, w) may be + oo if we consider a separable process X = { X(t), 


t 20}, but P{X(t)= œ} =0 for fixed t 20. 


Theorem 3. Let X be separable and measurable, and i be an instantaneous state. 
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Then for almost all weQ, the set 
So) = {tt > 0, X(t,w) = i} 


is nowhere dense in [0, œ). 


Theorem 4. Let X be separable and measurable, and t > 0 be fixed. Then for 
allmost all weQ, the following conclusions hold: 
(i) lim, X(s,) =i if X(t,w) =i and i is stable. 
(ii) X{s, w) has exactly two limiting values i and œ as si (or sft) if X(t,w) =i 
and i is instantaneous. 


üii) X(t, w) 4 oo. 


Theorem 5. Assume that X is separable and measurable. Then for almost all 
weQ, the sample functions X(-,@) have the following property. 

Property (A): for any generic t 20, as s|t (or sft} X(-,@) has at most one 
finite limiting value. There are three posibilities: 
{a) X(s,a@)— i. where i is stable; 
(b) X(s,«} has exactly two limiting values i and «, where i is instantaneous; 
(c) X (s, œo) > oc， 


Furthermore 


(a) if X(t, w) =i where i is stable, then (a) is true (with the same i) as st from | 


at least one side; 


(P) if X(t,w)=i where i is instantaneous, then (b) is true (with the same i) as 
s>t from at least one side. 


1.5.3 Canonical processes 
Definition 3. A process X = { X(t), t >20} is called right lower semicontinuous 
if, for all weQ, we have 


lim X(s,@) = X(t, w) 


st 


all t20 (4) 


A separable and measurable process that is right lower semicontinuous is 
said to be a canonical process. 


Theorem 6. Given a denumerable Markov process X, there always exists a 
canonical process stochastically equivalent to X. 


Theorem 7. A canonical process possesses the strong Markov property. That 
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is, for any stopping time t and AeéN,, arbitrary O<tg<t) <---<ty, Jo, 
jyo---JnEk, the following equality holds: 


N-1 
PLA, X(t +1.) =f, 0<V<N} = PLA, X(t + to) =Jo} TT pi (ei ~—ty) O 


¥=0 
Moreover, 
P{X(t+t)= o0|A}=0 t>0 (8) 


where A= {t < œ} and P{X(t)= 00|A} may be positive. 


1.5.4 Special examples 


(i) Poisson process. Let 4 > 0 be a constant. The process X = { X(t), t > 0} with 
the Q matrix 


is called a Poisson process. 

The Poisson process is a special birth process. Assume that there is a biological 
group, whose individuals are deathless and may give birth to new individuals. 
Let X(t) denote the content of the biological group (i.e. the number of all 
individuals) at time t. Assume that At is very small, and the probability that 
the content increases by one in the interval [t,t + At] is 2At + o(åt), the 
probability that the content increases by two and over in the interval [t,t + At] 
is o(At), and the probability that the content is invariable in [t,t + At} is 
1 — AAt + o(t). Such a process {X(t}, {> 0} is just a Poisson process. 

The transition probabilities of the Poisson process must be 

0 fj<i 
pl |e" Wes Jei 9) 
(j— i! 


{ii} Birth processes. A denumerable Markov process X = { X(t), t 20} with 
the Q matrix 


= 0 —A, A, 0 aye 
g= 0 0 一 42 A> Poe (10) 


is called a birth process. Here 4; > 0 (i = 0, 1,2,...) also. Let X(t) be the content 
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of the biological group at time t, and the individuals be deathless and give birth 
to new individuals. Suppose X(t) =i. The probability that X(t + At)=i+ 1 is 
4,At + o(At), the probability that X(t + At)>i+ 1 is o(At), and the probability 
that X(t + At)=i is t —4,At+ (At), Such a denumerable Markov process 
{X(t > 0} is a birth process. The transition matrix P(t) with its Q matrix (10) 
may not be unique. 

(iti) Birth-death processes. A denumerable Markov process X = {X(t),t > 0} 
with Q matrix 


一 {ao + bo) bo 0 0 
Q= ay 一 (ai + b,) bi 0 


0 az 一 (az 十 p2) b 


is called a birth~death process. Here ay > 0, by >0,a;>0,b,>0(= 1,2,...). 

Let X(t) be the content of the biological group whose individuals may give 
birth to new individuals and may die. Assume X(t) = i. For i> 0 the probability 
that X(t + At)=i— 1 is a,;At + o(At). For i > 0 the probability that X(t)=i+ 1 
is b,At + o{At), and the probability that X(t)=i is 1 — (a; + b,At + o(At). The 
Markov process X = {X(t), t > 0} is a birth-death process. 


PARTI 


GENERAL CONSTRUCTION THEORY 


CHAPTER 2 


Introduction to Construction 
Theory 


2.1 INTRODUCTION 


In this chapter the fundamental results of the construction theory are introduced. 
They are summarized as follows: the analytical properties of processes, such as 
continuity, existence of Q matrices, differentiability; the conditions under which 
the Kolmogorov equations are satisfied; the construction and properties of the 
minimal solution and the general form of the Q processes. The greater part of 
this chapter is derived from Reuter (1957). Sections 2.4 and 2.5 and Theorem 6.2 
are obtained from Chung (1967) and the conclusions in section 2.8 from Reuter 
(1959, 1962) and Feller (1957a). Sections 2.10-2.12 are derived from Xiang-qun 
Yang (1981a). 


2.2 NOTATION AND DEFINITIONS 


Let E be a denumerable set of indices. We call it the state space. We denote by 
m the Banach space that is composed of the bounded column vectors (or bounded 
functions) on E. Let the norm of f em be defined by || f || = sup,.,| f;|. We denote 
by ! the Banach space that is composed of summable row vectors on E and let 
the norm of gel be defined by jg| = È -z/gil. If fem, gel, their inner product 
will be defined by 


CANEDA NI (1) 
ieE 

Matrix notation wili be used and the limit of matrices will be defined element 
by element. From the analytical point of view, a Markov process (abbreviated 
to process) is a family of real matrices P(t) = (Pi j(t)} (i,jeE,t > 0) which satisfy 
the following conditions: 
(A} P(t)>0 Pil <1 
(B) P(t + s}= P(t)P(s) 
(C) lim P(t) = P(0)=7 

t0 
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where 0 represents the zero matrix and sometimes the zero column (or zero - 


row) vector; I represents the unit column vector whose components are 1. J 
represents the unit matrix. 

In terms of the elements of the matrix P(t), conditions (A), (B) and (C) become: 
for arbitrary i, je E, s,t 20, we have 


(A) p(t) 20 2 P(S 1 
J 
(B) p(t + 5s)= 3 Pat) Ps (5) 
k 
(C) lim p,,(t) = p,{0) = 6 f S 
Pitt) = PiN) = OG = oe og ts 
110 J J J 0 i Fj 
Here the sums are taken over E. (B) is usually called the Chapman—K olmogorov 
equation. 
We call i 
d(t)= 1 — X Pi(t) (2) 
j i 


the stopping function of the process P(t). 


Lemma 1. di(t) is a non-decreasing function of t. If d{t) = 0 holds for some t > 0 
and all ie E, then d;(t)= 0 holds for all t > 0 and icE. 
Proof. For s,t > 0, by (B), (C), 

j 


=}— » 2 pix(s)prj(t) 
j 
=1— P pal) È put) > 1 — » Puls) 


= d,(s) 


From this we see that d,(t) is non-decreasing. From the above expression we 
find out that if 3 p (t) = 1 for some t > 0 and all k, then d,(s + t) = 0 (s > 0). Since 
di(t} = 0, an easy induction gives d;(nt) = 0 for all position integers n. For any 
u20, choose n so that u<nt, then dju)<dj(nt)}=O because d,(-) is 
non-decreasing, and so d,(u) = 0. QED 


When d,(t} = 0 (i€ £) for some (hence all) t > 0, namely, 
(D) P(D)1 =1 t>0 
or equivalently 


(D) >» Pit) = 1 icE,t>0 
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then the process P(t) is said to be an honest process; otherwise it is called a 
stopping process. 

For a stopping process P(t) we can get an honest process P(t) by enlarging 
the state space as follows: take an arbitrary index A¢E, and write E = Eu {A}; 
set 


B; At) = pilt) Prat) = di(t) ijeE 
` 1 ifj=A 
Past | ifjeE (3) 


We then have the following lemma. 


Lemma 2. Let P(t)={p,,(t)} (i,jeE,t>0) be a stopping process. Then 
P(t)= {B;{t)} (i,jeE, t > 0) will be an honest process. 


The class of all processes P(t} is denoted by 2. 
It will be proved latter (Theorems 5.1 and 5.2) that for each P(t)eY, its right 
derivative P’(0) at t = 0 exists, that is, the limits 


p;,(t) — p; (0) 


ij = pi;(0) = lim 一 一 : (4) 
110 t 
exist, and 
Og gi; < (Æj) 
>》 qij S qu =q S (5) 
jz 


We call the matrix Q = (q,,) (i, je E) the Q matrix of the process P(t). 

When q; < 00, we say that the state i is stable. From now on we only study 
the process whose states are all stable, that is, the process has a finite Q matrix. 
We denote by P, the class of such processes, that is, their Q matrices satisfy 
the following conditions: 


0<q,;< oo (£j) 
qi EZ — Gi < © di =qi— 》 4; 20 {6) 


jti 
In order to emphasize the relation (4) between P(t)e?, and the finite matrix 
Q, that is, 


P'(0)=Q (7) 


we say that P(t) is a Q process. It should be emphatically pointed out that 
in this book all the states of the Q process P(t) are supposed to be stable. 
The class of all Q processes with the same Q matrix will be denoted by 


PQ). 
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2.3 THE PROBLEM OF CONSTRUCTION 


The problem of construction is a converse one. Except for Williams (1976), so 


far consideration of the problem of construction has been limited almost entirely 


to Q matrices satisfying equation (2.6). 
Let Q be a fixed matrix satisfying (2.6). We call d = (d,, ic E) a non-conservative 
column vector of Q. If d; = 0, we call i a conservative state. We call 


= {ild; > 0} (1) 


the set of non-conservative states. If H is empty, we call Q itself conservative. 

The formulation of the problem of construction is as follows. Suppose a fixed 
Q matrix satisfying (2.6) is given. Problem 1: is there a process P(t} satisfying 
(2.7)? In other words, does there exist such a © process? Problem 2: if there exists 
such a Q process, is it unique? Problem 3: if such a Q process is not unique, 
how can we construct all Q processes? 

The problem of construction was first proposed by Kolmogorov (1931), and 
he was the first to write down the system of backward differential equations 


(KB) pi,(t)= >) FiePe A?) ijeE,t 20 
k 


and the system of forward differential equations 


(KF) p;,(t) = 2 Palay i, jeE,t 20 
Feller (1940) proved that the Q process always exists. Moreover, he constructed 
the minimal Q process. So problem 1 is settled. 

Doob (1945) proved that for a conservative Q either there is only one Q 
process, i.e. the minimal Q process, or there exist infinitely many Q processes. 
For a conservative Q Reuter (1957) found out the necessary and sufficient 
condition under which the Q process is unique. Therefore for a conservative Q 
matrix, problem 2 was solved. For a general Q, Zhen-ting Hou (1974) obtained 
the uniqueness criterion for Q processes, and thus problem 2 is solved 
completely. 

As far as problem 3 is concerned, a complete solution seems still far away. 
There are two approaches to this problem at present. One is the analytical 
approach, as used in Reuter (1957, 1959, 1962, 1976), Feller (1940, 1945, 1956, 
1957a,b, 1958, 1971), Williams (1964, 1966, 1976), Zhen-Zu Sun (1962), 
Xiang-qun Yang (1964b, 1965a, 1966a) and Di-he Hu (1965, 1966, 1983). They 
mainly make use of analytical tools and methods to find solutions satisfying 
Kolmogorov’s backward or forward equations, which are Q processes, or to 
get the infinitesimal operators of the contraction semigroups derived from the 
Q processes, or to find the resolvent operators of the Q processes. The other 
approach is the probability method, Le. the limit transition method. This method 
was given by Zi-kun Wang (1958), resulting in a very successful solution to the 
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construction problem for birth-death processes {Zi-kun Wang, 1962; Zi-kun 
Wang and Xiang-qun Yang 1978, 1979). The basic idea of this method is to 
approach the sample paths of a Q process by those of Doob processes which 
have simpler structures. That is, the sample paths of a Q process are the strong 
limits of the sample paths of a sequence of Doob processes. This method was 
latter improved by Zhen-ting Hou (1975) and Xiang- -qun Yang (1978, 1979, 
1980a, b, c}. 

The solution to problem 3 by means of the analytical approach goes as 
follows. Suppose that Q is conservative. Reuter (1959) and Zhen-zu Sun (1962) 
constructed all Q processes in the case that Q is single exit. Feller (1957a), in 
the case of finite exit and finite entrance, derived all Q processes that satisfy 
simultaneously Kolmogorov’s backward and forward equations. Xiang-qun 
Yang (1966a), with the same hypotheses as Feller’s, obtained all Q processes. 
Williams (1964, 1966) and Chung (1963, 1966), with the fi nite exit hypothesis, 
found all Q processes. 

Since each Q process must satisfy Kolmogorov’s backward equations when 
Q is conservative but need not satisfy the backward equations when Q is 
non-conservative, it follows that few books or articles are concerned with the 


- problem of the construction of a general Q. 


As for the birth-death matrix Q, which is conservative except perhaps at the 
state 0, Feller (1957b, 1971) got all birth-death processes that satisfy both 
Kolmogorov’s backward equations and forward equations. Xiang-qun Yang 
(1965a) has constructed all birth-death processes, that is, the birth—death 
processes that satisfy one of the two systems of equations, or niether. In 
Chapter 4, for general Q in the case when O is single exit, we have constructed 
all the Q processes that satisfy the system of backward equations, and in the 
case when Q is single entrance we have constructed all the Q processes that 
satisfy the forward equations. Especially, we have derived all Q processes in the 
case of null exit when there exists only one non-conservative state. In Chapter 8, 
we find all the Q processes when Q is finite exit and finite non-conservative. 

It can be seen in the bibliography of this work that much work on the subject 
of the construction theory has been carried out by Chinese writers. 


2.4 CONTINUITY 
Theorem 1. If P(t)eF, then for arbitrary i, jeE and h> 0, 
lpii(t +h) — piAD| < 1 — paulh) (1) 


ldit + h) — di(t)}| < 1 — palh) (2) 
and, furthermore, the stopping function d;(t) and p; jt) are uniformly continuous 
in {0, 00). 


Proof. It suffices to prove the theorem in the case of the plus sign. By condition 
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(B) in section 2.2', 


pit +h) ~ p(t) = 2 Path) pailt) — pi,{t) 


= [ pith) — 1) p,,(t) + >A Palh) py At) (3) 
ki 


The first term is non-positive and > —(1—p,,(k)); the second term is non- 
negative, and <¥,4,pu(h) <1 —p,(h); hence (1) follows. Extend P(t) to P(t) 
according to (2.3) and apply (1) to j,,(t), and we obtain (2). The- proof is 
terminated. QED 


Theorem 2. The series 32;p;(t) is uniformly convergent in any finite interval 
[0, b]. 


Proof. By Theorem 1, both p,,(t) and 1 — d,(t) are continuous functions; hence 
it suffices to quote the Dini theorem (Titchmarsh, 1939). QED 


Theorem 3. Let h> 0. The sum 
» |pij(t + h) — pift) (4) 
J 


is non-increasing when t increases and is uniformly convergent to zero for 
t206>0 as h-0. In particular, for every 6 > 0, pi(t) is uniformly continuous 
in [6, oo]. 
Proof. Let 0 <s < t. By conditions (A) and (B) is section 2.2', 

2 [pit + h) — put) = > > [Pals +h) — py(s) Jprj(t — s) 

J 

< 5 | Pads + h) — pix(s)| > Py ft — 8) 
k i 


< > lpix(s + h) — pals)! (5) 


Thus, we have proved the first conclusion. Then on account of Theorem 1, p; ;({) 
is continuous; hence the above expression can be integrated for se{0, ô}. So if 
1 之 > 0， 


3 
Yi pilt + h)— pDl S zaa | |pix(s + h) — py(s}| ds 
i k 0 

But if O < h < ô, the second series is dominated by the series 


26 
7 ea | pa(s)ds 
k 0 


! Shortened in the following to (2.A) and (2.B) ete. 
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and, therefore, uniformly continuous in he[0,6]. But according to a theorem 
in Titchmarsh (1939), for every k 


ô 
lim | [Puls + h) — pi(s)lds=0 (6) 
h>0 JO 

It follows that uniformly for t > 6, 


2 é 
lim 5 p(t + h) — pO < Y(4/d)lim | pas +h) — pa(s)i ds 
j k 


A-0 JOG 
=F (1/5)0 =0 
k 


The proof is complete. QED 


Theorem 4. We have p;{t) > 0 in (0, œ); for i # j, we have p;(t) =0 or p(t) >0 
in (0, œ). 


Proof. (i) By (2.B), for arbitrary t > 0, we have 


Palt) > [pyult/n)]” 
From (2.C) it follows that p,,(t) > 0. 
(ti) Suppose i Æj. By (2.B) 
l Pit + 5) > pi(s)pi s(t) (8) 


Hence if we have pij(t1) > 0 for some t, >O, then p,,(t)> 0 for all t > t,. 
(Ni Suppose that to > 0 exists so that 


palt) = 0 (O<t< to) 
pal2to)=c>0 (9) 


for all n (7) 


To simplify things, we may suppose that E is the set of all non-negative integers. 
By Theorem 2 there exists a positive integer N so that 


pa pit) <¢/4 0<t<2ly (10) 
Set s = to/(2N), and en 
Am = {kipu(ms) > 0} mz> 1 (11) 
By (ii), Am © Ana. Write BI = A,, Bn = Am — Am- (m= 2). If kéA,, then 


0 = pilms) = 2 pijL(m = 1)s]p;(s) 
-5 piL(m i 1) )s] Pj fs) {12) 
jeAm- i 
Therefore, 
Pals)=0 jEAm-1,kfÁm (13) 


30 INTRODUCTION TO CONSTRUCTION THEORY 


If for some m, | < m < 2N, we have A,, = A,,_ ,, then by the above expression 
we obtain 


Palin + Ds]= 5 pilms)py(s)=0 EA, 


JEAm 


Hence Am+1 = Ám Repeating this proof we get A, = An (n > m}and in particular 
we have Ay = Agy. But by (9), 1¢A,, and leAsn. This contradiction shows 
that all Bn (1 < m < 2N) are non-empty and mutually disjoint. 

Let | <m<2N,then Am c Aay. IFKEA,,, then by (13), for every n > 1, we have 


pal + )s] =( » + 2 + 2 jaoapa 
Itm JeBm JEAm —1 


By (13) the third sum is zero, so 
>. Palin + 1)s] < by p;j(ns) + 2, p; (ns) 


HAm j¢Am JjeBm 


Summing n from | to 4N — 1, we have 
4N 
> pil4Ns)< > 》 pins) 
kéAm n=1 jeBm 
Because 1¢ A, the left-hand side at least equals p,,(4NS)=c, and therefore 
4N 
cs F > p; (ns) 


n= jeBm 


i<m<2N | (14) 


Since B,,B,,..., Bay are non-empty and mutually disjoint, there exists at least 
N of By (1 <n <2N), whose union is denoted by B, which is disjoint from the 
set (1,2,...,N). Thus 


Ne< > >》 pi(ns) | (15) 


n=1 jeB 


On the other hand, we have by (10) 
> pins) < 》 pi(ns) < ce/4 
jeB j>N 


Consequently the right-hand side of (15) is strictly less than 4N(c/4) = Nc. This 
contradiction implies that (9) cannot hold. The proof is concluded. QED 


Corollary 


For any fixed i, d,(t} is identically zero in (0, 00) or never zero. 


Proof. If suffices to combine Lemma 2.2 with Theorem 4.4 
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2.5 EXISTENCE OF O MATRICES 


Theorem 1. Let P(t)e-F, then for each icE 


r 1 os, ii t 
= pal) = tim Pal (1) 
210 t 
exists, but may be infinite. 
Proof. Put 
@(t) = — In pyt) (2) 
Then ®(t) is non-negative and finite by Theorem 5.4. By (2.A) and (2.B) we have 
Pals + t) > pls) put) (3) 
From the foregoing expression it follows that 
Dis +t) < O(s) 十 中 人) (4) 
Denote 
q: = sup [P(t)/t] (5) 
1>0 


If q; < œ, then for arbitrary £ > 0, there exists to > 0 so that P(to)/to >q; — E. 
But for every t > 0, we can write to =nt +ô (0 <ô < t), so 
— gc Pio) . NOU) +O) nD) DO) 


nt/tyg > 1 when t-0. By (2.C) we have ®(5)— 0. It follows that 
D(t) 


! -一 中 
qi—£ < lim <lim-- <q; 
190 t 110 t 
Since € is arbitrary, lim, 9 @(t)/t = q;. If q; =œ, upon replacing q;— € by the 
arbitrarily large positive number M, we still get lim, | 9 P(t)/t = œ. However, 


—Inf1—fl—p.. 
lim DO) es i 3 hil U Pat) 
tqo + 110 t 
-lim | Pal? 
110 t 
Thus, the theorem is proved. QED 
Theorem 2. For arbitrary i # j, 
: ijlt 
pi (0) = lim Pe) (6) 
t10 t 


exists and is non-negative but finite. 
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Proof. Let i#j and h>0. Define ,pi(h) = ! 
P(A) = È Pi WPi poh) (7) 
Sith) = >》 Pir, (A) Py sus) >> pr, (A) (8) 


where the sum is taken over those k, j,k, #j,...,k,_, Æj. Although we define 
jP;,(h) and f7{h) by analytical expressions, in actual fact they are respectively 
the probability of going from i to i in n steps without visiting j and the probability 
of the first visit to j from i in n steps for a Markov chain whose one-step 
transition probability matrix is {p,,(h)}. 

From (2.A) and (2.B), we can deduce that 


pulnh) > Y poppoli =m- DA] (9) 
jpalmh) = ,pin(h) + > pn-qm (19) 
punh) = È (ApyLlm— ah] (11) 


From the probability point of view, the above relations are even clearer. By 
(2.C), for £ < 4, there exists to > 0 so that 


max p;(t)<e max p,(t)<¢é 


O<1Kto O<t<to 
min p,(t)>1—e min p,(t)}>1—e (12) 
O<tEty OStSto 


From this and (11), we obtain 


thus . 
È Sith) (13) 


Hence, by (10), we get 
PE 各) > 之 Pi(mh) — max piiL(m — a)h] 


l<agm 


From this, if nh < to, then ,p7(h) > 1 — 2e. So by (9), we find 
pii(nh) > (1 {1 — 2e) pi(h }(1 —e) 2 (I 一 3e)np; (h) 


(h) 


pink) 、 (ae 
h h 


n 


if nh < to (14) 


ey = I -y a: a: 
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Set 
Aft 
qij; = lim Pill) 
110 t 


Then we have q;; < œ by (14), and moreover, there exists ti,0 <t; < to/2, so that 
Pij(ti}/ti <qijt+e 
The left-hand side is continuous in tı; hence, there exists ho > 0 so that 
Pij(t)/t < qi;+ 2e lt—ti|<ho (15) 


For arbitrary he(0, min (ho, 1,)), there exists n so that ti <nh<t,+h<ty. By 
(14) and (15), we get 


p) < Puth) 


(1 一 3e)—— nh < qi; + 2e 
Since ¢ is arbitrary, we obtain ae < qi;. QED 
Corollary 
For all ieE, the right derivative 
. dát 
D, = d;(0) = lim dilt) >0 (16) 
o £ 


exists and is finite. 


Proof. By Lemma 2.2, to get (16) it suffices to apply Theorem 2 to Pialt) = d,{t). 


QED 
Theorem 3. For arbitrary ieE, we have 
2 P,{0) + di(0) < — pi:(0) (17) 
ji 
Proof. Because 
5. p) 4 40) i i Pult) 
j¥i t t 
(17) follows by using the Fatou lemma. QED 


2.6 DIFFERENTIABILITY 
Let P(t)eP. Q =(q,;) = {p;(0)} is its Q matrix, and g; = — fius D; = d:(0). 
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Theorem 1. If q; < co! for fixed i, then p;;(t) (for all jeE) and di(t) have finite 
and continuous derivatives in [0, oc). Moreover 


[pit + h) — pit) S qih t>0,h>0 (1) 
ldi(t + h) — d,(t)| < gih t20,h20 (2) 
2 lp AO + a(t) < 24; t>0 (3) 

i 
ZrO+uO=-0 i>0 (4 
i 


Pilts + t2) = 2 Pilti Paltz) t1 > 0, 1,20 (5) 
k 


Proof. (i) By (4.7) and the definition of q;, we have 


palt) ze ™ > 1 — qit {6} 


From this, (4.1) and (4.2), (1) and (2) follow. 

Inequalities (1) and (2) show that p;;(t) and d,(t) satisfy Lipschitz’s condition; 
hence, they are absolutely continuous. It follows that p; (t) and d;(t) exist for 
aimost all t > 0. Furthermore, 


pit) = 5+ [ pi (u) du 0 
dit) = | ; d'(u) du (8) 
(ii) Set 
A, Att +s) = Pull Fs Pu 1>0,s>0 (9) 
A + EEAO t>0,s>0 (10) 


Since 5 jpi(t) + d;(t)= 1 and di(t) are non-decreasing, we have 
> A, (t,t+ s) + A(t,t+s)=0 (11) 
j 
A,(t,t +s) 20 (12) 
1When q; = œ, it follows also that p;,(t) and d,(t) have finite and continuous derivatives in (0, œ), 


and (5) holds for t, > 0, t, > 0. See Zi-kun Wang (1980, §2.2, Theorem 2} or Chung (1967a, 11.12, 
Theorem 8). 


a er et eet pin 
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By (4.8) and (6), it follows that 


(s) 


fap: | 
£ pilt) > — qipi At) (13) 


A, (t,t +s) > 一 一 一 
S 


Hence for arbitrary set A c E, we have 


È Ai (tt+s) 2-4 È pit) > — 4; (14) 


jeA jeA 
Starting from this and noticing (12), by (11), we get 
YLA(Qtt+sy=— } Att +s) Aftts) <q, (15) 


jeA jeE-—A 


So for arbitrary 4 c E, 


> Ayt t+ s)| <4 (16) 
jeA 
Moreover 
O<A(t,t+s)= —YA,At0+5) <4, (17) 
j 
Take A = { j| A;; > 0} in (14) and (15). We obtain 
>》 {Ail = ¥ Ai 十 2 (— Ap) < 24; (18) 
j JEA jeE—A 


From this it follows that 


2 Pi) < 24; (19) 
j 
so long as the derivatives involved exist. In particular the foregoing equation 
holds for almost all ¢ > 0. 


Sum (7) over j and add it to (8); it follows by (19) that the order of summation 
and integration can be interchanged, therefore 


>》 pi 的 十 十 (加 =1 十》 | p; (u)du + | di(u) du 
i J J0 D 
zig | (Sur + ditu) a 
ON\j 


| (Erio au) au =o 1>0 


0 


and it follows that 


Hence for almost all t > 0, we have 


2 Pit) + di(t) =0 (20) 
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(iii) Suppose that p; (t) and d;(t) exist for some t and (20) holds. We prove 
X(s) = J 1A, (t,.t +s) — p,(t)| 0 s}0 (21) 
j 


First we prove the case for the plus sign. Given arbitrary ¢ > 0, by (19) we can 
choose a finite set A c E such that 


gid, Pilt)+ È MPO <e (22) 
ifA JEA 


Hence, l 
X(s)< ¥ JA (t.0+5)— pi (ol+ ¥ |Ai(t,t +s) +e 


JEA i¢A 


Use 3’ to denote the summation of index j for A;; < 0. Then by (14) and (22), 
we have 

> lAl = L Aij—2 2 Ai; 

igA j i¢ 


< ¥ Aj, + 24; 2 p(t) 


jt 


< 》Aij 十 2 (23) 
Hence by (11) we have sa 


Z(s) < oy |A,,(t,¢ + s)— pit) 一 -¥ Ai 一 Ai 十 38 
JtA 


JA 


By (20) and (22), we obtain 
lim Z(s) <0 — È, pi ;(t) — d;(t) + 3e 
so jed 


= J, p; (t) + 3e < 4e 
py 


Thus we have proved (21) where the plus sign appears. 
In the case of the minus sign the above proof is still valid after a few revisions. 
Inequality (22) will be replaced by 


qi 2 pij(t —s)+ 2 Ipi <E (s <t) (24) 


The above expression holds by Theorem 4.2. Inequality (23) still holds after 


replacing p;;(£) by Pij ae s}. 
(iv) Suppose that p;;(t) and d;{t) exist for some t > 0 and (20) holds. Then for 
arbitrary u > t, by (21) 


=) 


i 
<FlAaltt+s)- pO >0 s40 
i (25) 


》， A; Au, ut 3) = > Palt) P, ;(u > t) > [A;(t, t+ s)— p(t) 1p. lu pi t) 


i 
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From this, it follows that 


[auss = > (- È Pixlt) Pu —t) is 
k 


j 


> Aalt, t +s)— palt) 0 s}0 


k 


Hence the right derivatives of p;;(u) and d;(u) exist. It is analogous to prove 
that the left derivatives also exist. Hence p; (u) and di(u) exist in (t, 00). Moreover 


P; {u) = 2, pial) plu —t) (26) 
di(u) = 一 2, Pilu) (27) 


From (19) and the two above equations it follows that p; j(u) and di(u) are 
continuous functions for ue(t, 00). Since by (i) it follows that the above t can 
be arbitrarily small, hence p; (t) and d;(t) exist and are continuous functions in 
{0, co); moreover, (4) and (5) hold. Because (19) holds for ail t > 0, according to 
Lemma 2.2 and by applying conclusion (19) to P(t), we obtain (3). 

(v) We are going to prove 


lim pi (t) = p; (0) lim di{t) = d;(0) (28) 
110 i140 
We only need to prove the first statement, because according to Lemma 2.2 


we can get the second statement by applying the first statement to P(t). 
By (6) 


pit + h) — pilt) > Lpa(h) — 1] pit) > — qihpij(t) (29) 
Therefore 
R; {t) = pt) + qipi(t} > 0 (30) 
Moreover, by (5) and (2.B), we have 
R, (t+ s) = 2 Rault) )Px js) s>0,t>0 (31) 


Hence 
R; {t + s) > R; (t)p;,(s) 


Since p; (t) is continuous in (0, œ), we obtain 


R;{s) > lim R; {t)p,,(s) lim R,,(s) > lim R(t) 
110 


tio 


Hence lim, |o R;,(t) exists, i.e. lim, ,0 p;,(t) exists. And by the mean value theorem 
of differential calculus, we have 


lim p; (t) = p’ (0) 
i110 


and the proof is complete. QED 
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Corollary 
If q; < œ, then for arbitrary ô > 0 
of —p..fu 
lim 7 Pi + s) — ptt) pi (u) = 0 (32) 
s~>0 j S$ 


holds uniformly for u > ô. 

Proof. The conclusion follows from (25) and (5). QED 
Theorem 2. Suppose q; < œ for fixed j, then for all ieE there exist finite and 
continuous derivatives of p;;(t) in [0, 00). Moreover 


Pi As +t) = $ palt)P,(s) t>0,s>0 (33) 
k 


Proof. By (4.8} and (6) 


pult + h) — pult) > pdt) pj (kh) — 1] > — pi(t)q;h 
Thus 
Dp, (tje™* ] = (Dp; At) + pita; le™ > 0 


where D represents the right lower derivative. Therefore p,,(t)e% is 
non-decreasing when t increases and Dp;,(t) are almost everywhere finite. 
Set 
vt) = Dp, A(t) + pidt)q; 29 | (34) 


Rewriting (2.B) we have 
pjs 十 et pa Palt) py fs)ev* 
k 
By differentiating the above equation for s and using Fubini’s theorem on 
differentiation’ it follows that for every t > 0 and almost all s we have 
vifs +t) = 3 Py (t)v, (5) (35) 
k 


If we use Fatou’s lemma, then for all s > 0 and t >0 we have 
vils + 1) > > palt)e,;(s) (36) 
k 


In particular, for almost all tẹ and all s < to, 
© > 0; (to) > pilto — 5)v,,(S) 


holds. So v;;(s) is bounded in any finite interval. By Fubini’s theorem it follows 


1See Saks (1937: p. 117} 
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that (35) holds for s¢Z and t¢Z,, where the measures of Z and Z, are zero, 
For some so¢Z, suppose that 


vijlt + So) > 》 pat) vi(so) (37) 
k 


holds for some t, then for t’ >t we have 


v;,(t' + So) > 2 Pilt — t)v, (tf + so) 
i 
> > palt 一 Nd Pilt Va ;(Sq) 
= 2 Palt vi(so) 


The above inequality cannot hold, because (35) holds for almost all £ when 
So¢Z. Thus Z, is empty when s¢Z. Also let s> 0 be arbitrary, 0<s’ < s and 
s¢Z. Then 


v(t +s)=0,{t+s—s +s) 


=} Palt +5— S')u 5‘) 
k 
= 2 2 Palt)Puls — s')v,;(s') = > Pilt)v,,(s) 


and it follows that Z is also empty. Hence (35) holds for all :>0 and s>0. 
Let t>0 and moreover let t, | 0, t 10 so that vijlt + t,) > Gij vijlt + ta) 一 Gii- 
We might as well suppose t’ <1,. By (35), 


Vilt + tn) = Pula — th )oi(t + t) 


Hence a; ; >a). By symmetry it follows that a;; = qij. That is, vij(t + 0) (i 2 0) 
exists. Similarly, we can prove that v; jt — 0) (t > 0) exists. Moreover, from 
vijlt + ta) = pilt,)v,(t) it follows that vjj(t+0)>0,,(t) (t20) From u,,(t)> 
Pilt,)v;,(t —t,) it follows that v; (t) > v(t —0) (t> 0). Therefore, v; jt+0)>0,,(t) > 
v; (t — 0). For t > 0 we can take 0 <s < t, since 


Vit — ta) = > Palt — s — t,) 0, TS) 
k 

v(t — 0) > by Palt — s)v,;(s) = v; {t) 
k 


Thus v;;(t) is continuous in (0,00). Hence pit) has the continuous Dini's 
derivative Dp; ,(t) in (0, co), and in fact there exists the continuous derivative 
p,(t) in (0,00) (Saks 1937, p. 204). As just stated, vj (0+) exists, namely, 
P; (0+) = lim, jop; j) exists. By the mean value theorem we get p; (0+) = p; (0). 
So p;,(t) is continuous in [0, oo), and (35), which holds for all t >0 and s> 0, 
becomes (33). The proof is complete. QED 


40 INTRODUCTION TO CONSTRUCTION THEORY 
2.7 THE KOLMOGOROV EQUATIONS 


Let P(tje¥Y. Notice that (6.5) and (6.33) do not necessarily hold for t4 = 0 and 
s = 0 respectively. That is, when q; < œ, 


(KB;) p;,{t) = 3 qir Py j(t) 
k 
does not necessarily hold, and when q; < œ, 
(KF,) pi (= 57 Palta t>0,icE 
k 


t20, jeE 


does not necessarily hold. But from 
A,,(t,t+ s}= >: A;,(0,s)p,(t)} = > Dilt)A, (0, s) 
k k 


and Fatou’s lemma it follows that when q; < œ 


Pi At) 2 qixPri(t) t>0,jeE (1) 
k 
hoids and when q; < oo 
p; At) 之 by Pity j t20,ieE (2) 


k 


holds. We call (1) and (2) backward inequalities and forward inequalities 
respectively. We call the system of equations (KB,) (i€ E), i.e. (3.K B), the system 
of backward equations; and (KF) (je £), i.e. (3.KF), is said to be the system of 
forward equations. 

Applying (1) to P(t) of Lemma 2.2, we obtain 


dit) >} qd, {t) + D; (3) 
k i 
where D; = d;(0) > 0. É 


If P(t)eY, and moreover (KBi) or (KF;) holds, then q; or q; is finite and also 
p; (0) = qij (JEE or ic E). In particular, if P(t} satisfies the system of backward 


equations or forward equations, then P(t) is a Q process, i.e. P(the AQ). In - 


fact, by (KB,), 
Di At) = qipii(f) + 5 ix Pyilt) 
k#i 


Hence q; is finite. Similarly, by (KF) it follows that q;; is finite. Taking t=0 
in (KB,) or (KF;), we get p;(0) = q;;. 

Naturally we may put forward the question: What are the conditions under 
which the Q process P(t)e? (Q) satisfies the backward or forward equations? 
We shail discuss this problem now. 

Lemma 1. Let P(t)e#. If (KB;) holds for almost all t, them (KB;) holds for ail 
t>0. 


一 一 ora 
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Proof. By hypothesis it follows that qx is finite. Moreover 


pult=5,,+ | (Zaanse) t>0 (4) 
Q k 

The integrand expression is continuous by (2.6) and (KB,) holds for all t> 0 
by differentiating with respect to t. QED 


Theorem 2. Assume that P(t)eY. For fixed i, the necessary and sufficient 
condition under which (KB,) holds is that q; is finite and moreover 


5 qijt+ D;=0 (5) 
j 
where D; = d;(0). 


Proof. Suppose (KB,) holds, then q; is finite and 
>; Pit) = 2 Fix 2 pri(t) 
j ko o j 
By (6.4) it follows that the above equation is equivalent to 


— di(t) = 2 dal! — d,{t)] 


By Theorem 6.1 it follows that, setting ! 一 0, we obtain 
—-D,= » dik 
k 


That is (5). 
Conversely if q; is finite and (5) holds, then by (1), (3) and (6.4) we find 


o= d Pit + di(t) 
>} qall — dA(D)]+ 2 dae(t) + D; 
= > qx +D;=0 
Hence equality must hold in (i), i.e. (KB,) holds. QED 


When i is a conservative state, that is, when 
qi= > qj<% (6) 


jt 
by Theorem 5.3 it necessarily follows that D; = 0. Therefore (5) holds. Hence 
we have as a corollary of Theorem 2, the following. 


Theorem 3. If (6) holds, then (KB,) holds. In particular, when Q is conservative, 
each Q process satisfies the system of backward equations. 
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Consequently when Q is conservative, the problem of construction is simpler, 
and the problem of deriving all the Q processes becomes the problem of deriving 
all the Q processes that satisfy the system of backward equations. 


Theorem 4. Let P(t}eP{Q). A necessary and sufficient condition under which 
the system of backward equations holds is for arbitrary t >0, 


h>0 j h 


And a necessary and sufficient condition under which the system of forward 
equations holds is that, for arbitrary t > 0, 


hoo 了 h 


a 2 Fix Px At) = 


= (8) 


ae Pislt) Qk; 


Proof. The necessity is derived from the corollary of Theorem 6.!. The 
sufficiency is obvious. 


Theorem 5. Let P(t)eY. If the system of forward equations (3.KF) holds for 
almost ali t > 0, then it must hold for all t > 0. 


Proof. Suppose Z is a null set and (3.K F) holds if t¢ Z. From this it follows that 


p; At) -56+| (Spat Mas) 


t 
> ĝ;j + asf plu) du + (1 一 bas Í pij(u) du 
0 0 


p- ôy 1f tr 
-一 一 之 qij f p,(u)du + (1 一 | Pp; (u) du 
t FJa tjo | 
By (2.C) and Theorem 5.1 and 5.2, we get 
ĝi; = pij(0) > qi + (1 — 6;,)4;,6,; = dij (9) 


Therefore ĝu > qj; > — 00, and hence all 4, j are finite; furthermore, by forward 
inequalities (2) we have 


POSS pala; t20 
k 
Combining (3.KF) of t¢Z, we obtain 


2 Piet) Gx; 一 go 和 0 téZ, i, jEE 
k 


(7) 
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- Since every term is non-negative, in particular, we have p,,(t)(q;; — qi) = 0 (t€Z). 


It follows that ĝ;; = q;;, that is, p; (0) = qij. Hence (3.KF) holds for t = 0. 
Now let u > 0 and moreover ue Z. We can find t > 0 so that (¢Z,0 < u — tẹ Z. 
So by Theorem 6.2 we have 


p; ,(u = Piti) )p, lu 


= an Pulu — t)gy; 


=) 13 Palt)Py(u 一 0 Jav 
= > Palu Jak; Ra 


Theorem 6. Let P(t)e?. If the system of forward equations holds, then 
Dd Pi(t)q,; is uniformly convergent in any finite interval [0, T]. 


Proof. By Theorems 4.1 and 6.2 it follows that both pj (t) and pa(t)q,; are 
continuous; then using Dini’s theorem we can prove this conclusion. QED 


It is to be pointed out that if we only construct the Q processes that satisfy 
the system of backward equations, we can change the non-conservative case 
into the conservative case. 


Theorem 7. Assume that P(t)eY(Q) and P(t) satisfies the system of backward 
equations, and P(t) = {B; ae ,jEE) is determined by (2.3). Then the matrix 
0 = P'(0) is conservative and P(t) satisfies the system of backward equations. 


~ (Q a 
6-(6 0 
where D= {D;}eg is a column vector. By Theorem 2 it follows that Q is 


conservative. By (3.KB) we can see that 


Bilt) = È, Gadi 0) ijeE (10) 
keE 


Proof. Obviously 


is valid for i,jeE. For i= A and jek, the above equation is obviously valid. 
For iéE, j = A, (10) becomes 


dit) = Z dudt) + D, (11) 
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When t=0, the above equation obviously holds. And when ! > 0, it can be 
derived from (3.KB) and (6.4), and the proof is complete. QED 


2.8 RESOLVENT OPERATORS 


Let P(t)eY. Consider the Laplace transform of P(t), W(A)= {w;4)} (Lek, 
A> 0): 


pA) = | e “p,(t)de 4>0 (1) 
0 


y(A){A > 0) are called resolvent operators of the process P(t). 
By (2.A)-(2.C) it follows that for arbitrary i, je FE, A, u > 0, 


w (A) 290 AY Wid) <i (2) 
j 
plà) — py) + (A y) > Wi (AW, (ut) = 0 (3) 
lim Ay, fA) = ôi (4) 
A 


Here the deduction of (3) from (2.B) requires the calculation of the integral 
fg fg p(t + se “~ “dds, for which see Feller (1971, XTII.8, Ex, (a), p. 452-3). 
We cail (2) the norm condition, (3) the resolvent equation and (4) the continuity 
condition. The matrix forms of (2), (3) and (4) are as follows: 


y(A}>0 Ay(A)l <1 (5) 
WA) — le) + (4 — wb (A (yu) = 0 (6) 
lim Ay(A) = (7) 
A+ o 
From (2.D) we obtain 
AD Wifd) = | (8) 
or 
Ay(A)l = 1 09) 


when P(t) is an honest process. 
The systems of back ward and forward inequalities (7.1) and (7.2) imply that 


Aw; (4) — 6; > dda asl) (10) 


Aw; (A) = bi; 之 L Walda (11) 
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From Theorem 7.3 we have 
Ab (A) — È dich) = 53; ieEE—H (12) 
k 


where H is the set of non-conservative states. 


Theorem 1. In order that w(A)(A > 0) are the resolvent operators of a process 
P(t)eY, the necessary and sufficient conditions are that the norm condition, 
resolvent equation and continuity condition hold. The process P(t) is honest if 
and only if (9) holds. 


Proof. The necessity has been proved already. We are now going to prove the 
sufficiency. Take w{A) to be a linear operator that operates on Banach space ! 
described at the beginning of section 2.2: for gel, gy (2)el, 


[gw (4)); = È gpl) (13) 


By the norm condition it follows that w(/) is a non-negative linear operator 
from | to and its norm is bounded by A~'. By the resolvent equation it follows 
that in the uniform topology of operators, 


d n 
(- <) WA) = ni yD (14) 
Hence 
d \” n! 
o<(-<) TOR (15) 
x d \" n! 
o<(-<) DW) < (16) 


Using the theory of complete monotonic functions (as can be seen in Feller 
(1971, pp. 415-18)), by (15) it follows that (A) is the Laplace transform of 
some measurable function f,,(t). From (15) and (16) we obtain the following 
two inequalities: 


0<f,(t)<1 (17) 
0<) fit) <1 (18) 


for almost all t > 0. Modify the values of f;;(t) on a set t whose Lebesgue measure 
is zero, so that (17) and (18) hold for all t > 0. We assume that the values have 
already been modified. 

Then we shall prove that, according to Lebesgue measure in the plane, 


fas +t) = > Sal) f(t) (19) 
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holds for almost all non-negative s and t. By the uniqueness theorem of the 
double Laplace transform it suffices to prove that the double Laplace trans- 


form 
we bp 
| | ue sudsdt 
0 Jo 


for both sides of (12) are equal. When å # v, the double Laplace transform for 
both sides of (19) are 


(v— A)” LWA) = wiv) J and > Wal AW) 


According to the resolvent equation, they are equal. Letting 4— v, from (14) it 
follows that the double Laplace transforms for both sides of (19) also are equal 
in the case A= v. . 
Now by modifying values of f;,(t) in a null measure set we shali obtain p;,(t} 
such that p;{¢) will become a Markov process. i 
Define p;;(0) = ô;; for t = 0 and define 


pat) =t! | fal) f(t — Wdu 


=t! | ( SaS lt — o) Jdu (20) 
0 k 


for t>0. | 
Since (19) holds for almost all (s, t), for almost allt > 0 the integrated expression 


in (14) is equal to f,,(¢) for almost all ue(0, t). Hence 
pit) = f(t) for almost all t > 0 


and the function 
g(t) = | Salt) f(t — Wdu (23) 
0 


as a convolution of two bounded measurable functions fix and fpj, is continuous. 
However, the series ¥,g,(t) is dominated by the series 


| fic(W du (22) 
0 


term by term. In addition, each term of series (22) is continuous. Therefore by 
Dini’s theorem it follows that the series (22) is uniformly convergent in any 
finite interval {0, T} so that series Dgx(t) is uniformly convergent in 0, T], 
and hence p,(t)=t 'Y4ga(t) is continuous in (0, T). It follows that 


p,,(t) is continuous in (0, oo) (23) 
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By (21) and (23), from {17) we have 
0< p(t) <1 for all 1 >0 (24) 
By (18) and (21) we obtain that 


2 pit) < | (25) 


-Jis valid for almost ali t > 0. By (23), using Fatou’s lemma it follows that the 
above expression holds for all :> 0. 

We have already proved that P(t)= {pi(t)} satisfies (2.A) and (2.C). We 
proceed to prove that P(t) satisfies (2.B). Considering that (21) and (19} hold 
for almost all {s,t), we have 

pils + t) = ¥ pigs) py ft) for almost all (s, t) (26) 

k 

By (23), the left-hand side of the above expression is continuous for s > 0,t > 0. 
Hence in order to prove that (26) holds for all s>0,t>0, we only need to 
prove that for fixed s > 0, the right-hand side of (26) is continuous for t > 0; 
and for fixed t > 0, the right-hand side of (26) is continuous for s > 0. By (23) 
and (25) it follows that the first conclusion is right. In order to prove the second 
conclusion, we only need to prove that for fixed t > 0, the series 


2 Piz(s)p,;(t) 


is uniformly convergent in any interval [a,b] (0 < a < b). By (24) it suffices to 
prove that the series $; pals) is uniformly convergent in [a,b]. In fact, by (20) 


Sro | 


0 


t 


( ; 2 fa(W filt E jd 


=t) >| (Eh = u) )du 


By (18) it follows that the above series 3°, is dominated by series (22), and it 
has been pointed out that series (22) is uniformly convergent in any finite interval 
[0, T]. Hence the series 3,pi(t) converges uniformly in [a, b]. 

We have already proved that the elements of P(t) = {p;(t)} are measurable 
functions, and that (2.A) and (2.B) hold, namely, P(t) = {p,,(t)} is a measurable 
generalized transition matrix. Therefore the limit lim, „o + p(t) = uj; exists (see 
Zi-kun Wang 1980, Theorem | in section 2.1) or Chung (1967, II.1, Theorem 


3). According to Abel’s property of Laplace transforms, with which we are 
familiar, we have 


lim 4,4) = lim p,,(t) 


Ax 1 一 0 + 
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By noticing also the continuity condition (7) of w(A) it follows that (2.C) holds. 
Thus P(t) = {pi(t)} is a Markov process. Its resolvent matrix is the given (A). 
The sufficiency is proved. 

Let P(t) be honest; obviously (9) holds. Conversely, assume that (9) holds. If 
jpii(t) < 1 for some t > 0, then by the corollary of Theorem 1.4.4 $ ;pi(t) < 1 for 
all t > 0, so that (9) cannot possibly hold. Thus (9) implies that P(t) is honest. 
The proof is complete. QED 


Theorem 2. Let the derivative matrix of P(theF be Q = (q;,), and let its resolvent 
operators be W(A), then ; 
dij = lim AL AW; (A) = dij] f (27) 


A> am 


Proof. When qi; is finite, for any arbitrarily given ¢ > 0, there exists 6 > 0 so 
that, if t >ô, 
Pit) = Oi 


t i 


Therefore 


ACi (A) 一 bij] = qi; = 


A? | e~“Tpi(t) — ôi ~— git] dt 
0 


ô oo 
< zf e~*etdt + | e (2+ |qptt)dt 
Q 


å 
= e[ —e7 {As + 1) + 1] +24e7% + jgyle (46 + 1) 
When 4 一 co we have 
üm Alya- 4] ~ ql <e 
Because e is arbitrary, (27) follows. 
When q; is infinite, for arbitrary N > 0, there exists ô > 0, if t <6, such that 
[pa(t}—1J/t<—N 


Consequently 


oo å 
AL Aw dA) — 1] = 2? | e~*Tp.(t)— 1] dt < al e7 *( — Nti)dt 
0 0 
= 一 NT 一 e+H+ 日 一 六 


Because N is arbitrary, lim, ,,A{Ay,(4)— 1] = — œ. Thus the theorem is 
proved. i QED 


When O is finite, we call condition (27) the Q condition. 


(4 — œ) 


mn an: A A a: e a 


Te r a a aai ee ee a, 
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Theorem 3. In order that w(A)(4 > 0) are the resolvent operators of a Q process 
P(t)eY,(Q), the necessary and sufficient conditions are that the norm condition, 
resolvent equation and Q condition are valid. 


Proof. This is quite obvious because the Q condition implies the continuity 
condition. QED 


Hereafter, the resolvent operators w(A)(A > 0) of a process or a Q process will 
be directly called a process or a Q process, and denoted by w(A)eF or WUE P(Q). 


- Theorem 4. Assume that Q is finite. In order that ¥(A)EA(Q) and w(A) satisfies 


the Kolmogorov backward equations (3.KB), the necessary and sufficient 
conditions are that the norm condition, the resolvent equation and the backward 
(B) condition 


Gl — QW(A)=1 4>0 (28) 
are valid. The expression of the B condition with elements is 


Aw (A) — > Fixx) = Ô;j A>0,i,jEE (29) 
k 


Proof. Taking the Laplace transform of (2.K B} and noticing the initial condition 
(2.4) we obtain the B condition (29). The necessity is proved. 

We now consider sufficiency. By the resolvent equations we get (A) (41). 
By (27) we have 


Willo AT oo (30) 
Also by (29) we obtain 
(A + qipi) lo AT x (31) 
Hence 
Ap; (A) + òi; A> (32) 
i.e. the continuity condition holds. Again by (29) we have 
AL AW; (A) = ô] = Z dutl) (33) 


By (32) and the dominated convergence theorem it follows that the Q condition 
holds. As a result p(AjeF,(Q). 

According to Theorems 4.1 and 6.1, both p; jt) and 3.4, P.;(t) are continuous 
functions of t, whereas (29) shows that they have the same Laplace transform. 
Hence they are equal, i.e. the backward equations (3.K B) hold. QED 


Theorem 5. Let Q be finite. In order that w(A)e#(Q) and (J) satisfies the 
system of Kolmogorov forward equations (3.KF) the necessary and sufficient 
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conditions are that the norm condition, the resolvent equation and the forward 
(F) condition 


WA(AL—Q)=I 4>0 (34) 
hold. The expression of the F condition with elements is 
AW (A) — Yo Wil Ada = i 4>0,ijeE (35) 
k 


Proof. Taking Laplace transforms of both sides of (3.KF) and noticing the 
initial condition (2.C) the F condition (35) follows. The necessity is proved. 

We prove next the sufficiency. By (35) it follows that (30) still holds, Again 
by (35) we have 


Vd M+ qo Aĵo > (36) 
So we find that (32) still holds, too. By Theorem 1, y (44> 0) are the resolvent 
operators of a process P(tf}e2. 


AL Aw; ;( A) — 6;;] = Lada; . (37) 


Likewise the Q condition holds, i.e. y(AjeF,(Q). 

By (35) it follows that the functions pi(t) and 3°,py(t)q,; have the same 
Laplace transform. Therefore they are equal for almost ail t, i.e. (3.KF) holds 
for almost all t > 0. According to Theorem 7.5, the system of forward equations 
(3.KF) holds. The proof is complete. In the proof of Theorem 7.5, it is proved 
directly that pi = qij; Le. peP AQ), pA)eP(Q). QED 


Definition 1. (A), which satisfies (28) or (35), is said to be B-type or F-type 
respectively. 


2.9 FELLER’S EXISTENCE THEOREM 


Does a Q process exist for a fixed matrix Q that satisfies (2.6)? In other words, 
is the P.(Q) empty? Feller (1940) solved this problem: he constructed the minimal 
solution. 

Define fi(t)(t > 0) as follows: 


it) = 0 
troue ree | (x du Sti) )e du 
0 +i 


or equivalently 


(1) 


p(t) = 0 
t 
fy O= ô; if Tai e7 "| 


0 


(z Fleas) et du 
#j 
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Set 
SOT AD) as nT x (3) 


To show that (1) is equivalent to (2), consider the Laplace transforms 
(4) (4 >0) and $,(A) of f3) and fe) 


$°(4) =0 
i (4) 
O= 6,4 E T aye 
oy 4) Ata,” pi gO 
or 
pLa) = 
on ay= 5,4 5 ony j 
i} A+; ij Fj AG; 
Condition (3} becomes 
PAT pilh) nf co (6) 


It remains only to prove that (4) is equivalent to (5). Using matrix notation is 
simpler. Denote 


M=(1,;) 
Hs — ô; jqi;)/4; as q; > 0 (7) 
Oij as qi 一 0 
Set 
H(A) = {11,,(A)} 
i (8) 
IT; (4) = M; 
Define diagonal matrix 
4l+q=diag{i + qì (9) 
Then (4) becomes 
(A) = 0 
pr" (A) = OAA +a) + TAg”) 
By induction we have 
9" "(ND= 》 MA + qa! n>0 (10) 


a=0 
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From (5) it follows that 
$°) =0 
G+ HA) = TIAA + gh! + OO + DAA + 
By induction we still have (10). Hence (6) becomes 


n 


$+)= F AAI + Tol) ee (11) 


a=0 


Theorem 1. f(t)eP,(Q) and moreover f (t) satisfies both Koimogorov’s backward 
and forward equations. Moreover, f(t) is the minimal Q process, that is, for 
arbitrary P(t)e?,(Q), we have 


pit) 2 fyt) t2Q,ijek (42) 
Theorem 1 can be expressed by the resolvent operators as follows: 


Theorem 2. {àE P (Q) and moreover (A) satisfies both the backward and 
forward equations. Furthermore, $(2) is the minimal Q process, that is, for any 
W(Aje PQ), we have 


iA) > pyl) 4>0ijcE ` (13) 


Proof. tt suffices to prove Theorem 2. While clearly (12) implies (13), the 
converse implication is not obvious. But suppose that (13) holds, i.e. that 
(A) = (A) for 4 > 0, and look back to the proof of Theorem 8.1. There (8.14) 
tells us that 


(— dda (yO — PA = art] 
whence easily 
0 <(— d/dA (yD — bd) < ne 


so that p,,(4)— blå) is the Laplace transform of a function g(-) satisfying 
0 <g(t) <1 for almost all t > 0. Hence p;;(t) > filt) for almost all t > 0, so for 
all t > 0 by continuity. 

For a more elegant argument, see Feller (1971), Chapter XHI.{0, Theorem 3, 
p. 426; this leads to the result that [(n/t)y(n/t)]”" > p(t) and likewise [(n/t}6(n/t) J” > 
f(t), so that obviously (4) > (A) implies p(t) > f(t), we need to prove that f(A} 
satisfies the norm condition, the resolvent equation, the B condition and the F 
condition, and that (13) holds. 

The non-negativity of (4) is clear. By induction we have AD; 7(4) < 1 for 
all n; thus the norm condition is satisfied. 

To prove that the resolvent equation of $(A) holds, we only need to prove 
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that for all n 
THAAD t — (lul +a) ! 


=(u-4) X TA +g)" T +q)! (14) 


holds. By summing over n in the above expression, the resolvent equation 
follows. 


To prove (14), denoting the right-hand side of (14) as A, we have 
IA) An = Ane a ~ (m AMAT +g) I (uu + gq) (15) 
Thus (14) holds for n =0. Suppose (14) holds for some n. Operating IE on 
the left-hand side of (14) we have 
TI(A)A,, = TI" HAA + 9 — TAG) +a) 
= Pt HAA + gy) — TI (el + gy? 
= (p — AAU + q) I aul +g)! 


~ By substituting the above expression into (15), it follows that (14) holds where 


n is replaced by n+ 1. Hence (14) holds for all z. 
By (4) and (5) we obtain 


(A+ adp (i) = Ôj + 2 apil) (16) 
k+i 
or (A) + dj = Oi 证 2 OA COCE (17) 
k#j 
Letting n— oo, the B condition and the F condition of (A) are satisfied. 
Finally, let y (4)E? {Q}. It is clear that y,,(4) > py, (A). From (8.10) and (4), by 
induction we can easily see w;;(2) > $7,(A) for all n. Hence we obtain (13), and 
the proof is complete. QED 
2.10 PROPERTIES OF THE MINIMAL SOLUTION 


Lemma 1. Letacolumn vectorf > 0 and a row vector g > 0. Then when nf œ, 


oT AS (1) 

n” Tgl) (2) 
where ¢" is determined by 
g=0 

eta 45 fog (3) 


A+Q;, kzFid+ gi 
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and y" is defined as 


n+1 Gj n kj 4 
tg gn A (4) 
4 4+qi kj “十 gj 


Proof. It suffices to set č” = "(A) f and n" = g¢"(A). Then (1) and (2) hold, and 
by (9.16) and (9.17) it follows that (3) and (4) hold. QED 


Lemma 2. Assume that a column vector f > 0, while u satisfies 
(A+ qi= 2 aij t+Si ieE 
itj 


0<u; so (5) 
Then u > ġ(å)f. 
Suppose that a row vector g > 0, whereas v satisfies 
và +a)= X vast 9 jEE 
O< so A 6) 
Then v > gġ(å). 


Proof. It suffices to prove the first case. Because u > = 0, owing to (5) and 
(3) and by induction, we obtain u > č"; hence u > $(A)f. The proof is complete. 


QED 
Set 

A(u, A) = 1 + (u — 19 A,u>0 (7) 

Lemma 3. A(n, a) is bounded', and for arbitrary À, 4, v > 0, 
A(u, ND AD ¥) = Alu, ¥) | (8) 
pO AR, 4) = Alu, VP = OA) (9) 

In particular, 

A(p, AAA, u}= I (10) 


That is, for A(y, A), there exists a bounded left inverse matrix A(A,“) and a 
bounded right inverse matrix A(A, p). 


‘A matrix A =(q;,) is said to be bounded if sup} (aj; < œ. 
ij 
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Proof. By using the norm condition and the resolvent equation of (A) it can 
be easily obtained that A(u, å) is bounded and (8) and (9) hold. QED 


Denote the equations 


(U,) du; -¥ q,;4u; =0 ieE {11) 
j 


The class composed of all solutions uem to equations (U,) will be denoted by 
M ,, The class composed of all non-negative solutions uem is denoted by A+. 
MT (K) denotes a subset of .A+ whose elements are bounded by K. Denote 
the equations 


The collection of all solutions ve? to equations (V,) will be denoted by 2,. The 
collection of all non-negative solutions ve £, is denoted by #7. 


Lemma 4. If fem, or MW), then Alp, A) fem, or Mi. I geL, or L}, then 
gA À EL or FF. 


Proof. If f EM, then by the B condition of $(A), 


QAlp, AS = Of +u — AAHAS 
=uf +(u— AAAS- S] 
=4A(u, A) fem 
That is Alu, À fem, 
Let femi. When 2 < p, obviously 
Alp AVS =f + (u — ApS = 0 (13) 
When å > u, we have 
(l—-O)f=4—pwf 290 
By Lemma 2, f > (å — p)f, that is, A(1, A) f > 0. 
Similarly, we can prove that gA(p, AEZ, or Fi. QED 


Theorem 5. Ad(A)1 = 1 — ġ(å)d— X(A), that is, 
Ay $i AA) 三 l py y 由 (4jd。 Ea X (A) (14) 


acH 


' The above calculation needs careful justification, because Q = {q; j) may fail to be bounded so that 
we cannot appeal to the associative Jaw of multiplication to obtain 


A- Oj) PAS] =f {X) 


from (AI ~ Q)d(4)=/ (the B condition for ¢(A)). A strict proof of (X) will probably involve 
interchanging the order of repeated summations: see the proof of Lemma 11.6 below. 
The reader will notice that this point occurs repeatedly later on. 
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where H is the set of non-conservative states, d= (dj) is the non-conservative 
column vector of Q and X(A) is the maximal solution of 


(Al — Qu =0 O<u<l (15) 
Moreover, u" = I1"(A)1 | X(4). We define u” as follows: 
u? =0 TH Fe yn 16 
data (16) 
Proof. By the B condition of (A) 
(Al -Q)6~)d=d | (17) 
(I — Q)[1 —ag(At] = (41 — OM — a= - Ql =d (18) 


By Lemma 2 
1— åp) > (Nd 
Thus by (17) and (18) we find that 
X (4) =1—Ad(AN — (Ad 


is the solution of equation (15), and also we obtain (14). 
By Lemma 1 it follows that 1— X(A4)= (A)(A1 +d) is the limit of the 
increasing sequence č", where 
At+d; dik o, 
o0 十 二 _ zn 19 
Ši Ši A+ 4; vitae uo) 
Thus X(A) is the limit of the decreasing sequence u" = 1 — ¢". By the above 
expression (16) follows. 
Finaily, suppose that u is the solution of equation (15). So by u <1 we have 
u=TI(4) u < TI(4)4. Therefore u < I}"(A}l, and hence u < lim,- „p H(A) = X (A), 
that is, X(A) is the maximal solution of equation (15). 


Lemma 6. If ue.#, and |u| <1, then l 

- X(4) < u < X(3) (20) 
Proof. The right inequality has been proved in the proof of Theorem 5. The 
jeft inequality can be proved similarly. QED 


Lemma 7. If X (4) #0, then 
sup X,(4) = 1 inf X, i,(A)d, = 0 (21) 


i aceH 


inf [(Ayu], = 0 uem ` (22) 
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Proof. Let sup; X;(4)=a, then O<a<t. Since a7'X(ije.#7(1), by the 
maximum of X(/) we have a`! X (A) < X), so 1 <a: hence a=1, namely 
sup; X,(A)=1. From this and (14) we obtain inf,>\..,@(,(4)d,=0 and 
infi [Al]; = 0. Thus we get inf, [@(A)u); = 0 for uem. The proof is complete. 

QED 


2.11 EXIT FAMILY AND ENTRANCE FAMILY 


Definition 1. (€{4), 4 > 0) is called an exit family if 0 < &(A)em and 
(uw) = ACA, ACE iu>0 (1) 


An exit family (¢(A), å > 0) is said to be harmonic if €(A)e.“7. 
{nlà}, 4 > 0) is called an entrance family if 0 < n(å)el and 


n(n) = n(AA(A, p) A,u>O0 (2) 


An entrance family ((4), 4 > 0) is said to be harmonic if nUjeY;. 
Obviously, for an exit family (A) or an entrance family (A) we have 


g(a) na) (AT œ) (3) 
Moreover if €(4) =0 or n(A) = 0 for some A, then they hold for all å > 0. 


Definition 2. We call 
č = lim ¢(%) (4) 


ajo 


‘the standard image of the exit family €(/} (A > 0). We call 


n = lim (A) (5) 
Ata 


the standard image of the entrance family 4(A) (A > 0). 


Lemma 1. Let č be the standard image of exit family €(A), then! 


f= 6 + eT CH) 有 > 0 (6) 
č = (A) + AP(A)E A>0 (7) 
where 
Pr =limg(4)= 7 n'q! (8) 
alo n=9 
Let 1 be the standard image of entrance family »(A), then 
n= n(n) + p(T 4>0 (9) 
n = H(A) + A4n9(4) 4>0 (10) 


1Agree on 0. œ = œ. 0=0, 1/0= œ. 
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Proof. Notice that 
E(A) = EC) + (u DOA (11) 
E(u) = E(A) + (A DP (12) 


If $; Tč) < œ, (6) follows by letting 410 in (11). If $}; Pio) = ©, let ALO 
in (11); by Fatou’s lemma we have 


Ši > ode) +H 2 TijéAW)= 2 


Therefore (6) still holds. In the same way, let | 0 in (12), and we obtain (7). 
Similarly, we can prove (9) and (10), and the proof is complete. QED 


Corollary 
Given a fixed i, č; < œ if and only if for some (hence for all) A> 0 we have 
[AADEL = ATEA) J < 20 
In that case, we have 
[Ap(AET, = $: — $A) 4>0 
Similarly, given a fixed j, y;< œ if and only if for some (hence for all) 4 > 0 we 
have 
Làng); = Lån]; < © 
In that case, we have 


[Ano(A)] = n; 0) A>0 


Lemma 2. Denote X° = lim, jo A@(A}L. Then 


$ X*+ X4 X= 1 (13) 
aeH 
where 
Xt =T ad, acH (14) 
is the standard image of the exit family | 
XA) = palda aeH, 4>0 (15) 
Thus i 
p(X" = X" — X(N) acH (16) 
X is the standard image of the exit family X(A). Hence 
Ap) X = X — X(A) A>0 (17) 


X is a solution of the equation 
Ilu=u Oxus! (18) 
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while 
Ad(A)x® = X° (19) 


and X° is the maximal one of the solutions that satisfy the condition Ad(A)u = u 
and equation (18). 


Proof. From the resolvent equation of $(4) it follows that X“(4) (ae H) is an 
exit family whose standard image is 


X; = lim X$(A) = lim ¢,,(A)d, = iad, (20) 


alo alo 
On account of (10.14) Eey XA) <1 and therefore $ ey X° < 1. Hence (16) 
follows from (7). 

By (10.14) and (16) we obtain 


wai -f x) =1— 》 X°- Xx”) (21) 
acH aeli 

From this and the resolvent equation of (å) it follows that X(4) (4 > 0) is an 

exit family. And since X (å) < 1, we know its standard image < 1. Hence by (7) 

we obtain (17). Also because 


(AI — Q)X(4) =0 0< X(A)<1 


and consequently, letting 4} 0, we find that X is a solution of equation (18). 
By (10.14), Seq XA) + X (å) < 1. Letting 210, we obtain A¢(A)1 | X° and 


X°=1— ¥ X*- X30 


aeH 


‘From this, (13) follows. By (17) and (21) we obtain (19). By the B condition of 


(A) we have 


(I -QAAN =4 (22) 


and Ag(A)1 | X° {410} In the foregoing expression, let å}0, and we obtain 
QX° =0, that is, X° satisfies (18). Suppose that u satisfies (18) and ip (Nu = u. 
Then u = A¢(A) u < AP(ANI, hence u < X°. 


Definition 3. X is called the maximal exit solution of matrix Q, and X° is called 
the maximal passive solution of matrix Q. 


Lemma 3. (i) n(A) (4 > 0) is an entrance family if and only if there exists a Riesz 
decomposition as follows: 


n(A) = ap(A) + H(A) (23) 


where the row vector «>0, and there exists some (hence all) 4>0 so that 
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ap(Ajel, that is 
E 1 — > xX) x | < cc (24) 
aeH 


i(A)e + isa harmonic entrance family. The vector a and hence 4(A) are uniquely 
determined by »(A): 


n(A- Q) = « (25) 
H(A) LO An(A) > a (AT oc) (26) 


(ii) €(A) (A > 0) is an exit family if and only if there exists a Riesz decomposition 
as follows: 


E(A) = (AB + EA) (27) 


where the column vector f > 0, and there exists some (hence all) 4 > 0 so that 
p(A)Bem. E(Aje. Wf is a harmonic exit family. Vector f and hence (A) are 
uniquely determined by (A): 


(AI — Q) = B | (28) 
(À) 10 Ag(A) > B 


Proof. We first prove (i) and proceed to prove the necessity. Since (1(A), 4 > 9) 
is an entrance family it follows that for arbitrary v > 0, 4 > 0, we have 


niv) + (v — An(v) P(A) = nà) 2 0 
nly) = (4 — v)n(v) (A) 
niv) > (å — vin 二 (一 中 > mpl | 


vy j(v) = =a V2) ALAG; (A )— oij] 
In the summation on the right-hand side of the above exptession, the terms for 
i # j are non-negative. Hence according to the Q condition of me and Fatou’s 
lemma, let A> co, and we obtain 


vyj») 之 2, nAV)4ij 


Hence there exists a finite non-negative row vector a(v) so that 


novi — Q) = alv) (30) 


By Lemma 10.2, n(v) > a(v)G(v), therefore a(v)p(v)el is valid for all y > 0. From 
the F condition of @(A) it follows that for any non-negative row vector q, 
provided ad(v)el, there exists 


aP(v)(vl —Q)=a (31) 


(AT 20) (29) 
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Hence 


niv) = afol) + AC) (32) 


where H(v)e Z}. Multiplying the above expression from the right by A{v, 4) and 
noticing (10.9), and (2) as well, we obtain 


nlà) = av) P(A} + HVAC, A) (33) 


According to Lemma 10.4, 4(v}A(v, Wet. Substituting (33) into (30) and 
mae 2 we obtain a(v)= a{A), that is, «(4)= x is independent of 4. Thus 
A(v)A(v, A) = H(A). In this way (32) becomes (23), where there exists non-negative 
TOW aes aso that ad(A)el for all A > 0, and {7(4), A > 0) is a harmonic entrance 
family. From (3) and (25) we derive the first expression of (26). From this and 
the dominated convergence theorem, letting 4 æ in (25), we obtain the second 
expression of (26). The necessity is proved. The sufficiency is obvious. 

Now we are going to prove (ii). Suppose that (&(A), 4 > 0) is an exit family. 
Noticing (2.6), for arbitrary v > 0, the column vector 


B(v) = (vi — QO) (34) 
is finite. On account of (2.6) the B condition of (å) is 


(vf — QE) = (VF — QV LT + (2 Wo] 
= {(vl — Q + (4 — volv) l f(A) 
= [VF -Q + (4 — W]e) 
= (Al — QA) 


Therefore, f(A) = f is independent of A > 0, and hence (28) holds. From (3) and 
(28). we derive the first expression of (29), Because of this and the dominated 
convergence theorem, let 2— œ in (28) and we obtain the second expression of 
(29). The limit £ > 0 in the second expression of (29) because &(4) = 0. According 
to Lemma 10.2, from (28) we get č(v} > (v)f, hence @(v)fPem is valid for all 
v>0. By the B condition of (4) it follows that for any non-negative column 
vector f, provided ¢(v)Bem, we have 


(vl — Opm = R (35) 
Hence from the above expression, (28) and lemma 10.2, we have 
E(v) = Pv) + E(v) (36) 


where €(v)e.#. Multiplying the above expression from the left by A(v, A) and 
noticing {10.9} and (1) we obtain 


E(A) = $B + Alv, AE) (37) 
Therefore &(A) = A(v, A)E(v). Hence (E(A), A > 0) is a harmonic exit family. Thus 
the necessity is proved. The sufficiency is obvious. QED 
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Corollary 

When AT x, : 

AXA) Diada acH (38) 
AX (4p 0 (39) 


XA) 10 
X{A) {0 
Lemma 4. If (n(A),A > 0) is an entrance family, then o? = A[n{A), X°] < œ is 


independent of A> 0. If (€(A),A > 0) is an exit family and its standard image 
čem, then 


(À — pe) EWA), 80] = 2E), E ~— en, è] . (40) 
ALMA), JTV < 20 (41) 

In particular, when ae H | 
VS = ALH(A) XIV < oo (42) 


where 
V° = Ve + (uld, 


Suppose that y denotes the standard image of the entrance family (y(A), A > 0). 
Then 


is independent of p (43) 


EC €] = Ln, (4) ] (44) 
If [4, X°] < oc, then 
[y, X°} =0 (45) 


Proof. By (2), (7) and čem, 


ALn(A), ÈJ = ALM WA(t, A), CJ 
= A[n(u), Alu, ACJ 
= Alin), či + (u — ALN). AP(ACT 
= Anu), č] + (4 — àin) é — SA] 
= pinu), é] + A DDD, (46) 
From this, (40) follows, and therefore (41) is obtained. Similarly, by using (19), 


it can be btained that a° is independent of /. 
When aeH, &(A) = X%(A), (40) becomes 


V3 = Vi (A wine), X"(4)] (47) 
Since AX“%{A} < d,, by (37) and the dominated convergence theorem, 
Can), AXA) nd, Ato, acH (48a) 


Hence let å> œ% in (47), and (42) and (43) follow. 
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When 1 一 0， 
(A — what), SUDI = ALMA), ČUDI — en), C9] — ANA), E] 
From this, let 4 一 0 in (40) and we have 
AL €] +0 


Thus tet 4~+0 in (40), and we obtain (44). 
By (39), if [y,X°]< œ, then a° <A[n,X°]30, as 4-+0. Hence o° =0, 
[y(A), X°] = 0. Letting 4-0, we obtain (45). QED 


if pO (48b) 


Lemma 5. If Q is non-conservative, then 


2Y Xe 人 一 A oo (49) 


“cH 


Proof. We have 
Z(A) = 1 — AoA = > XA) + XA) 
acH 


is an exit family, and moreover (41 — Q)Z(A) = d. Hence by Lemma 3, ALZ{A)d. 
Noticing (38), (49) follows. QED 


Lemma 6. If, for the row vector a, f(A) = 0 (that is, X; a,0;{4) = 0 for every j, 
and moreover the series is absolutely convergent), then x = 0. 

If, for the column vector $, $(A)$ = 0 (that is, 2; %:8; =9 for every i, and 
furthermore the series is absolutely convergent), then p=0. 
Proof. Since ¢(4) satisfies the system of backward equations, it follows that 


Ap; ;(A) = Oi 十 di iA) (50) 


Fix i, Multiplying both sides by fi; and summing the resulting expression for 
j, we obtain 


O= B+ > > Fix ADB; = B+ zw 人 2 ata, = B; 
j k k i 
The order of summation can be interchanged because 


下、 au 4216 ) = >1p(5 aul) = È (Zut + 2q) 
= ZIBA) ERR OESTE 24:)2 PAB < 00 
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Applying the F condition of (A), 
Ag fA) = dit pis) (51) 
k 


we can prove similarly that x = 0. - QED 


2.12 GENERAL FORM OF Q PROCESSES 


If pAeP(Q) then y(A)— o(4) > 0. As yA) satisfies the system of backward 
inequalities (8. 10) and (8.12), whereas @(A) satisfies the B conditon, it follows 
that (AI — Q)[y(A) — #(4)] = 0. Moreover if ic E — H, then equality holds. More 
precisely, for fixed j, u; = vi{4) — $A) satisfies 


Au; — È ditty = diF fA) (1) 
k l 


where F'(A) > 0 and d is the non-conservative quantity. By Lemma 10.2 
B; fA) = WA) = Pid) = > bial Ald F(A) 29 
acH 


If j is fixed, B (We i (1/4). Thus the first part of the following theorem is 
derived. 


Theorem 1. Any Q process #(A)eY(Q) must take the eee form: 
WA) = P(A) 十 2 x} (AFCA) + B; fA) (2) 


where X°(A)=@,,{A)d, (aeH). If i is fixed, then O<B,(Ajel, if j is fixed, 
B. (Weni (1/4). Moreover, 


F%(4)>0 ALFA), 1] <1 acH (3) 


If (A) satisfies the system of backward equations, and Q is non-conservative, 
then F(A) =0 (ae H). 

If yA) satisfies the system of forward equations, then when i is fixed, 
B,(Aje Z}. And if Q is non-conservative, then F “Nei (aeH). 


Proof. Since w;(A)el when i is fixed, so F*(A)el (ae H}, Bi(Wel. . 
Suppose (4) satisfies the system of backward equations, and Q is 
non-conservative. By Theorem 8.4, 


Z XDF ae bid Ad F(A) = 
aeH 


By Lemma 11.6, this is equivalent to F%(4) = 0 (ae H). 
If yA) satisfies the system of forward equations, since both (A) and (A) 
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satisfy the F condition, it follows that if we set G(A) = (dF YA) } (i, je E), then 
LAGI + B(A) AL — Q) = 0 
Multiplying from the left by (AJ — Q) we obtain 
G(X — 0} = 0 


Hence B(A)(Af — Q) =0. That is, for fixed i, B, {We}:, FA)eL} (aeH). 


Now let us prove (3). In section 7.18 we shall also prove (3). Here we shall 
give another proof. 


Operating 27 — Q on both sides of (2) and summing (2) over j, we obtain 


(AL — OW DD =A + 2 Sind aA LFA), 1] (4) 
If i=a, = 
(AI — O) AWAD, = À + d ALFA), 1] (5) 
Taking Laplace transforms on both sides of (7.3) we have 
(Al —Q)AWA <Al+d (6) 
By (5) and (6), (3) follows. QED 


Theorem 2. Each Q process #(A)eY{Q) must have the following form: 
p) = $: (A) ) 十 > Hal AP, ;( (A) + C4) (7) 


where H(A) = (H;,(A)} > 0 and C(4)= (C,{4)} > 0. When i is fixed, C,(Ae Zi; 
when j is fixed, C.(A)em, H. ,(A)em. 

y(A) satisfies the system of backward equations if and only if H. (Ne.d 1, 
C_(A)je. M7 (1/4). 

W{A) satisfies the system of forward equations if and only if H(A) = 9. 


Proof. By the system of forward inequalities (8.11) and the F condition of 
lå), we have 


LYA) — OA) IAT — Q) = H(A) 20 
Therefore, by Lemma 10.2 
C(A) = Wl) — f(A) — Hiel) 2 0 
and C;(Aje Zi; hence we have (7). By (7) we obtain C. ,(A)em. Since 
H Ap (a) < W AW <1 


it follows that H. (A)jem 
The B condition of YA) is equivalent to 


(AF — QLH Al) + C(A)] = 0 


66 INTRODUCTION TO CONSTRUCTION THEORY 


Multiplying the above expression form the right by (Al — Q). we have 
(Al — Q)H{A) = 0. Thus by the above expression we have (Af 一 Q)C(A) = 0. Hence 
the B conditionis equivalent to C.,(Aje.#; (1/4), H. (AEH i. 
The F condition of y{A) is equivalent to 
[HOGA + CYA) IAT ~ Q)=0 


That is, H(A) = 0. The proof is complete. | QED 


CHAPTER 3 


Construction of O 
Processes in Simple Cases 


3.1 INTRODUCTION 


Q is assumed to be conservative in many works on construction of Q processes 
such as Reuter (1959), Feller (1940, 1945, 1957), Doob (1945), Chung (1963, 
1966), Williams (1964, 1966) and Xiang-qun Yang (1966a) because in that case 
any Q process satisfies the system of backward equations. Only a small number 
of articles like Reuter (1962), Feller (1957b, 1971) and Xiang-qun Yang (1965a) 
are concerned with non-conservative Q. If we just construct the Q processes 
satisfying the system of backward equations, we may do so in principle by using 
Theorem 2.7.7 for P(t). But this construction is not an immediate one. Moreover 
this way of construction does not suit the construction of Q processes satisfying 
the system of forward equations. 

In this chapter we consider construction of Q processes in simple cases, and 
it is not necessary to assume Q to be conservative. If Q is conservative and in 
single exit, all Q processes have been constructed in Reuter (1959). As for non- 
conservative Q, a class of honest Q processes that do not satisfy the system of 
backward equations are constructed in Reuter (1962). In section 3.2 all Q 
processes satisfying the system of backward equations are directly constructed 
in the case of single exit. A class of processes containing the results in Reuter 
(1962) are constructed in section 3.3 for non-conservative Q. In particular, when 
Q is single non-conservative and in null exit, we construct all Q processes. And 
in section 3.4 all Q processes satisfying the system of forward equations are 
constructed when the minimal solution is a stopping process and furthermore 
in single exit. The results of this chapter are scen in Xiang-qun Yang (198 1a). 


3.2 SINGLE EXIT CASE: CONSTRUCTION OF Q 
PROCESSES SATISFYING THE BACKWARD EQUATIONS 


By Lemma 2.10.4, the dimension m* of the solution space .@ of the system 
of equations 


(Al —Q)u =0 O<uem (1) 
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is independent of A. When m* = 0, that is, if. $ constains only the zero element, 
Q is called null exit. When m* = 1, Q is called single exit. And if m* is finite, 
Q is called finite exit. 

Suppose that Q is single exit. By Lemma 2.10.6, X(4) #0; on account of 
Theorem 2.10.5, the minimal solution (A) is a stopping process. According to 
Theorem 2.12.1, every Q process (A) satisfying the system of backward 
equations possesses the following form: 


WA) = (A) + X (AF (A) (2) 


Under the conditions of m* > 0 we shall determine the conditions under which 
F(A) makes w(A)eP,(Q), that is, y(A) satisfies the norm condition and resolvent 
equation because the B condition is always satisfied for (4) defined by (2). 


Theorem 1. Let m* > 0. For (A) defined by (2) to be a Q process it is necessary 
and sufficient that either w(A} = (A) or y(A) can be obtained as follows: 

Take a row vector x20 such that xġ(4)el, and take a harmonic entrance 
family #{Aje Z $. Moreover 


n(A) = xå) + (A) #0 (3) 
Take a constant c such that 


[a XJ+ + F (XI+ V)<c | (4) 


acH 


is satisfied, where X°, X, X*(aeH) are defined by Lemma 2.11.2, while 


5° = ALAA), X°] <00 is independent of 4 (5) 
Ve = AERC), XV < cc Ato,aeH (6) 
V= Ve + i (Ad, is independent of 4 (7) 
Finally set 
i (4} + H(A 
WA) = Gi (A) + X (A) D a a (8) 


c+ [x X — X(A)] +i), X] 
The process y{A) is honest if and only if 
Q is conservative and, moreover, [a, X°] + 0° =c (9) 


The process y(A) satisfies the system of backward equations. The necessary 
and sufficient condition under which this process satisfies the system of forward 
equations is that « =Q. 

When m* =1 the above-stated processes include all the Q processes that 
satisfy the system of backward equations. When O is conservative and, further- 
more, m* = Q, the processes above include all Q processes. 
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Proof. By minimality of (A), W(A) > 0 is equivalent to F(A) 20. Upon noting 
(2.10.14), the norm condition is equivalent to 


F(A) 20 X(A)ALF(A), 1] < X+ F X42) (10) 
aehH 
Because of (2.10.14), 
T Xi) = pad = F MAU d<] (11) 
aeti n=0 
Therefore, 
mo > x)= > MAA +g) 'd 0 n> 50 (12) 
neH a=n 
Multiplying (10) from the left by II"{4} and taking its limit, we obtain 
X(AALF(A), 1] < X) 
Hence A[ F(A), 1] < 1. Consequently, the norm condition is equivalent to 
F(A) 20 ALF (A), 1] <1 (13) 
W{A) is honest if and only if 
Q is conservative and, moreover, A[ F(A), 1] = 1 (14) 


Since (A) satisfies the resolvent equation, substituting w(A} in the resolvent 
equation, and observing that X (å) is an exit family, we obtain that the resolvent 
equation of (A) is equivalent to 


F(A)A(A, = {1 + (p — ALFA), XO Fo) (15) 
Or by (2.10.10), upon multiplying the above formula by A(u, å) from the right, 
we find that (15) is equivalent to 
F(A) = {1 + (u — DEF (4), X (GDI) FUO4( å) (16) 
If, for some u > 0, F(u} =0, then from the formula above we know that for 
all A > 0, F(A) = 0. Hence (A) = $0). P 
Otherwise, for all >O, F(z) #0. Since ALF(A), X09] < AL F(A), F< 1, it 
follows that 1+(u—A)[F(A),X(u)]>0. From (16) it can be seen that 
F()A(p, A) 20. Therefore, if one u >Q is fixed, then (A) = F(wA(p, å) is an 
entrance family. Thus, (16) is equivalent to 
F(A) = m,n(A) m, >0,n(A) #0 (17) 


where the quantity m, satisfies 


m, =m, + (u — Aym,[n(4), XD Im, (18) 
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where (A) is a non-zero entrance family. According to Lemma 2.11.3, 4{A) has 
Riesz representation (3). 
Dividing (18) on both sides by m,m,, we obtain 
mot =m! + (u — An), X G9] (19) 
But by (2.11.40), : 
(a — AEn), XH) = aint). X] — AEA), X] (20) 
Consequently (19) becomes 
my! —A[n(A), X] =e 
Hence by (2.11.17), 


(constant) (21) 


1 I 
AT et ALMA] e+ Alaa), X] + ALAA), XI 
. 
~ e+ fo, X — X(A)] + ALA), X] 
Furthermore, every deduction from (18) to (22) can be inverted. 
Substituting (17} (22) in (13), we have . 
A[n(A), 1 - X] <c (23) 
But by (2.11.13), (2.11.16)-(2.11.19) and Lemma 2.11.4, 
Afn(A), 1 — X] = ALa@(A), 1 — X] +AA), 1 — X] 


= if agx” +} xe | + a| may x" + 》 a 


(22) 


aelf aeH 


-| > (x+ 5 xe) Jaa? > 


ael aclt 


=[aX°]+0°+ ¥ ([x, X" -— X44] + V4) 


dE 


tla, X°]+6°+ Y iX © Ato 24 

acH 
The last step is arrived at on account of (2.11.37). Therefore, the norm condition 
(23) becomes (4) whereas (14) becomes (9). Operating on (8) from the right by 
(Al — Q), we find that the F condition hoids if and only if «=0. The other 
conclusions of the theorem are quite clear, and the proof is complete. QED 


In the proof of Theorem 1, if, in (2), we replace x(A) by a solution E(4) to the 
equation (2.10.15), which is a non-null harmonic exit family, and slightly modify 
it, the theorem remains valid. For this we have the following theorem. 
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Theorem 2. Let m* >0. Let &(A)e.@ 7 (1) be a non-null harmonic exit family 


and let ¢ be the standard image of Ë(2), Sup; &,(4) = 1. For W(2jeP(Q) defined 
by 


Wild) = GA) + EDF) (25) 


it is necessary and sufficient that either w(4) = d(A) or WA) can be obtained as 
follows: Take a row vector x>0 so that ag(A)jel, take a harmonic entrance 
+ 


family 7(A)EL | so that (3) holds and satisfies 


[x, X ~Fl<x 
W, = AA), X —FtW< cc ATR (26) 
Take a constant c such that 
[x X°)+ 6° + [a X- E] W ¥ (fa X] 7) ge (27) 
acH 


is satisfied, where the notation is the same as in Theorem 1. Finally, set 


NE Skt P(A) + 4,(A) 
ij A)= ij\* (A Pe Sa. ae ae 28 
ie Cakes oe Feeley ts oe 


The process (A) satisfies the system of backward equations. For the process 


to be honest, it is necessary and sufficient that Q is conservative, and 


Eli) = XU) [x X°] + 0 =e (29) 


33 NULL EXIT CASE: CONSTRUCTION OF Q PROCESSES 
WITH ONE NON-CONSERVATIVE STATE 


Suppose that Q is non-conservative, and moreover, 
Z(4)=1—-AP(AN1 = > X*(2) + X(A) (1) 
Obviously Z(A) is a non-zero exit family, whose standard image is 
0 (2) 


Now let us find the necessary and sufficient conditions on F(4) under which 
w(A}eY (Q) can be defined by 


WA) = Pilà) + ZAA)F (A) (3} 


Since Z(A)¢.M | it follows that the B condition does not hold. Thus we need 
to consider the norm condition, resolvent equation and Q condition. 
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Theorem |, For (A) defined by (3) to be a non-minimal Q process it is necessary 
and sufficient that w(4) can be obtained as follows: 

Take a row vector x > 0 such that a@f{/jel, and take a harmonic entrance 
family js; ; furthermore, (2.3) holds, and also it is necessary to satisfy 


fo,Z}+U=0 if « 40 (4) 
or, equivalently, 
[x, 1] + Y= œ fx#0 (5) 
where 
= A[n(A), Z] tU AT oo (6) 
Y, =A), 1] f Y AT oo (7) 
And take a constant c so that 
[x X°] + 6° <c (8} 
is satisfied, where o° is the same as in (2.5). Finally, set 
rX PyjlA) + HAA) 


Wit) = 6:44) + ZA) a he ae =o 7 OTOZ] 


The process wy{4) does not satisfy the system of backward equations. It satisfies 
the system of forward equations if, and only if, x = 0. For the process yw{2) to 
be honest, it is necessary and sufficient that 


[x X°] + 6° =c (10) 


Proof. Following Theorem 2.1, in order that the norm condition and resolvent 
equation may hold, it is necessary and sufficient that (2.17) holds,- where (J) 
processes representation (2.3), and m, is determined by (2.22) (by replacing 
X, X (A) with Z,Z(A)). Substituting (2.17) and replacing (2.22) in the norm 
condition (2.13), we have 


Ain- zZ] <e (11) 


But 
A(n(A), 1 — Z] = å[n(4), X°] = [a, X°] + 6° (12) 


Consequently (11) becomes (8). 
For Ņ(4} in (9) to be a Q process, the Q condition is yet to be checked, that is, 


A 
A oe (13) 
Ara € a A[n(A), Z| 
Noting (2.11.38), from (2) and Lemma 2.11.5 we have 
AZ (A) d; (A x) (14) 
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By Lemma 2.11.3, Ay(A) >. Again by Z,(A)]0 it follows that 
ALy(A), Z] = La, Z — Z(A)] + ALAA), Z] 


Tle, Z]}+U AT x (15) 
Hence (13) becomes 
aia as om 
and this is equivalent to (4). Since Z = 1 — X°, by (2.11.39), 
a? = And), X°] = fx, X°] +8? < oo (17) 
It follows that (4) is equivalent to (5), and the proof is concluded. QED 


According to Lemma 2.10.4, the dimension n+ of the solution space LF of 
the equation 


v(Al — Q)=0 


is independent of 4. When n* = 0, the matrix Q is called. null entrance. Ifat = 1, 


O<vel (18) 


‘the matrix Q is called single entrance. If n* is finite, the matrix Q is called finite 


entrance. 

Suppose Q is non-conservative and non-null entrance, then we may take x = 0 
and the non-zero harmonic entrance family je 1 in Theorem 1. Hence the 
nof-minimal Q process w(A) in Theorem 1 exists. 

If Q is non-conservative and null entrance, then for the non-minimal Q 
process ¥(A) in Theorem | to exist, we must have « >0 so that aġ(åjel and, 
moreover, [4,1] = œ. This condition can be given by the following lemma 
(which is also found in the work by Zhen-ting Hou (1974, Lemma 12.2.4). 


Lemma 2. There exists a > 0 so that a@(A)el while [x, 1] = æ% if, and only if, for 
some (hence all) A > 0, 


inf AY $,,(4) =0 (19) 


Proof. Suppose that there exists « > 0 such that for some A > 0, we have ap(Ajel 
and, moreover, [%, 1] = oo. From the resolvent equation and the norm condition 
of (å) we know that aġ(å)el holds for all A> 0. Since 


ALap(A), 1] = [a, 21] 
> [a,1]inf45 py) 


it follows that (19) is valid for all A > 0. 


74 CONSTRUCTION OF Q PROCESSES IN SIMPLE CASES 


Assume that (19) holds. Since A@,,(A) > 0, it follows that 42 ,@;,(A) > 0. Hence 
it is deduced from (19) that there exist mutually different REE, k = 1,2,3,..., 


` such that 


A 中 中 让 < 1/2" 
J 


Take 
evita 
ifj¢ {i iz.) 


and we have 


Afad(A), 1] = [wait < > 1/2: 1 


EASE y 1=o 
k=1 k=1 
The lemma is proved. QED 


The condition (19) is equivalent to 


sup Z,(A) = | (20) 
If X(2) £0, then by Lemma 2.10.7, 
sup X (A) = | | (21) 


Therefore (20) is satisfied. 
Suppose X(A) = 0; then (20) becomes 


sup È X(N) =| (22) 


i aeli 
If Q is single non-conservative, that is, H contains only one state a, then (22) 
becomes 


sup X f(A) = | (23) 


or, equivalently 


sup bia( = l/d, (24) 


Theorem 3. Assume Q to be null exit and, furthermore, non-conservative only 
in one state a. Then 


Z AA) 74 PialAd, Z; = Fiada = | — X? (25} 
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where T is defined by (2.10.8). If Q is null entrance, and also 
sup PialA) < l/d; 


then the Q process is unique. 

If Q is non-zero entrance, or if Q is null entrance and, moreover, (24) holds, 
then the Q process is not unique. In this case every non-minimal Q process can 
be obtained by means of Theorem 1. 


3.4 SINGLE ENTRANCE CASE: CONSTRUCTION OF 
Q PROCESSES SATISFYING THE FORWARD EQUATIONS 


In this section Q is not required to be conservative, but we assume that the 
minimal solution is a stopping process, and that n* > 0. Then we can select a 
non-zero harmonic entrance family (ie Z $ . If the Q process (A) has the form 


WA) = plà) + F;(A)n fA) l (1) 


then Ņ{å) satisfies the system of forward equations. Conversely, if n+ = 1, then 
every Q process (A) satisfying the system of forward equations must take the 
form ({). Under the condition n* > 0 we shall determine F(A) so that wW{A) in 
(1) is a Q process. As the F condition is always satisfied, we only need to 
investigate the norm condition and the resolvent equation. 


Theorem 1. Suppose that the minimal solution (A) is a stopping process and 
n* >0. For (A) defined by (1) to be a Q process it is necessary and sufficient 
that either y(A) = (A) or y (1) can be derived as follows: Take a constant ô >0 
and a harmonic exit family &(4)e.4"4(1), whose standard image is © If 5 >0, it 
is also demanded that sup; €,(4) = 1 is satisfied. If Q is non-conservative, then 
for each aeH, take a quantity 8° > 0 such that X peg ß X "(Nem, and, moreover, 


EA) = 2 Bex A) + EN #0 (2) 
acH 
and | 
W, = ALAA), X — kôč] TW < oo Ato 
where! 


č= 2, BX" + dE #0 
k = inf {1/6, 1/B°, (ae H)} (4) 


‘Agree on 1/0 = œ. 
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Take a constant c such that 
e+ Wt ¥ (Ll — kB V4 Ske (5) 
acH 


is satisfied, where o°, Fa are defined by (2.5) and (2.6). Finally, let us set 
(Sac B°X H(A) + 5E (A) (A) 


2 l z (6) 
VD ON I XT + ADE 
The process w (14) is honest if, and only if, 
F=X pr=s (aeH) b-'c=6°. (7) 


The process y(A) satisfies the system of forward equations. For the process 
yA) to satisfy the system of backward equations, it is necessary and sufficient 


that $° =0 (ae H}. When n* = 1, the processes obtained above include ail the _ 


Q processes satisfying the system of forward equations. 


Proof. On account of (2.10.14), the norm condition is equivalent to 
0< F(A) FAEG), 1 < 2 X4) + XA) (8) 


acH 
In analogy with (2.15), the resolvent equation is equivalent to 
A (pu, AMF (u) = F(A) + (A — F(A), FQ] (9) 
or, equivalently, 
F(p) = {1 + (4 — WAA), FW} AG WE ; (10) 


so that if F(A) = 0 for some / > 0; then F(A) = 0 for ali 4 > 0, therefore y (4) = ġ(4). 
Otherwise (10) is equivalent to 


F(A) = m,¢(A), m,>0,C(A) #0 . (11) 
where the quantity m, > 0 satisfies 
m, =m; {1 + (4 — WEA), Jm} (12) © 


whereas &(A} is a non-zero exit family. According to Lemma 2.11.3, (A) has 
Riesz representation 


E(A) = OB + EA) # (13) 


where the column vector 620 is such that ${4)Bem, and the exit family 
Ëe. Až. Using Lemmas 2.10.6 and 2.10.7, it is easy to prove 2 ô = sup; Ë; (4) 
is indenendent of A>0. If 5=0, set F(A) = 0; if ô > 0, set EN = 57 '2(A). Then 
(E(A), 4 > 0) is a harmonic exit family. Let its standard image be č; hence 


sup E(A) =1 if d>0 (14) 


PR PEN PT PT t-te Re Neer 


SINGLE ENTRANCE CASE 77 


comparing this with (2.12.2), we obtain f; = O(jeE — H). Upon setting f° = B,/d, 
(ae H}, (13) becomes 


= F B°X%(A) + ôE) #0 (15) 
acH 
whose standard image is 
E= > px? + 5€ 40 (16) 
aeH 


We are going to prove A[n(A), č] < œ. If not, upon dividing (12) on both 
sides by m,m,, we have 


i 


mi! =m! + (à — wl), EU] 
Setting u] 0, we obtain 
mi 之 bn (A — WAA), (1 = ALAA), č] = oo 


Thus m, =0, which contradicts (11). 
By using (2.11.40), 


(u — ALAA), OCH) ] = ulale), CI ~ ALAA), s] (17) 


Therefore, upon dividing {12) by m,m,, we find that there exists a constant 
c such that 


m,= {c + Aq), J}! (18) 


Upon substituting {11} and (15) in (1) and comparing the result with (2.12.2), 
we obtain Fip = B’m,n(A). 
Observing (2.12.3), we have 


Bm, A( H(A), 1] < 1 aeH. (19) 
By substituting (15) and (11) in the norm condition (8), we find 


< ¥ X(N + Fl) (20) 


acH acH 


( > BX) + SEO jmail 
Operating on the formula above by II"{A), setting n— œ, and considering 
(2.12), we obtain 


Š (Am, AL H(A), 1 < X (A). (21) 


Hence it can be seen that the norm condition (20) is equivalent to (19) and (21). 
By (14) and 


F(A) < X (4) (22) 
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we obtain that (21) is equivalent to 


òm, ALAA), 1] <1 nr (23) 
Thus the norm conditions (21) and (19} become 
m,A(H(a), 1] <k (24) 


By (16) and (4), 0 < k < œ. Upon substituting (15) and (18) in (24) we find 


AERA), X°} + F. ALAA), X°] + ADH), X] 


acH 


<kce+k > BARCA), X°] + KdALH(A), E] 
aeH 
that is, 
6° + W+ ¥ (1 kp V3 < ke (25) 


ach 


Setting Af oo, we find that the norm condition is equivalent to (5). 


If ¥{A) is honest, we must establish an equality in the second formula in (8), _ 


that is to say, the equalities in (21) and (19) hold. From this it follows that 
Bp’ =6 (ae), E(4) = X(A), ie. č = X. Hence k=6~', and the equality in (5) 
becomes 6° = 6 ic. Therefore, for y (å) to be honest, the necessary and sufficient 
condition is (7). The other conclusions to the theorem are easily seen, and the 
proof is complete. QED 
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CHAPTER 4 


Uniqueness 


41 INTRODUCTION 


Given that @ satisfies (2.2.6), there always exist Q processes. This chapter 
discusses the problem of uniqueness. Section 4.2 provides the necessary and 
sufficient conditions for uniqueness of Q processes satisfying the system of 
backward equations. Section 4.3 gives those for uniqueness of Q processes 
satisfying the system of forward equations. The content of these two sections 
is derived from Reuter (1957). The proof of the Hou—Reuter theorem in 
section 4.4, that is, the criterion for uniqueness of Q processes, is obtained from 
Reuter (1976), but now it has been simplified and improved. Thus, the problem 
of uniqueness in construction theory has been completely solved. 


42 UNIQUENESS THEOREM: THE SYSTEM OF BACKWARD 
EQUATIONS 


When we consider the problem of uniqueness of the Q processes satisfying the 
system of backward equations, the equation 
(U,) ju — Qu =0 (1) 


will play a prominent role. Recall that the set of solutions uem of the equation 
(U,) is denoted by .#,, the set of non-negative solutions uem is written as Mi, 
and the set of solutions in A which are bounded by K is denoted by .4 + (K). 
The dimension of .H+ is denoted by mt. Fr 


Theorem 1. The following conditions are equivalent: 


(i) The Q process satisfying the system of backward equations is unique. 
(ii} For some y >0 (hence all A> 0), Æ, consists of the zero solution only. 
(iii) For some 4 >0 (hence all A> 0), M 1 consists of the zero solution only. 
If one of the above-stated conditions does not hoid, then there are infinitely 


many Q processes satisfying the system of backward equations. If Q is con- 
servative, there exist infinitely many honest Q processes satisfying the system 
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of backward equations; if Q is non-conservative. then all © processes satisfying 
the system of backward solutions are stopping. 


Proof. (i)=>(ii). Suppose (ii) does not hold. By Lemma 2.10.6, X{j) #0. The 
process (A) obtained by taking A(A) = 0,02 0,[o,1]=1, and c= [x, X°] in 
(3.2.8) satisfies the system of backward equations. If Q is conservative, such w(A) 
is still honest. But there are infinitely many choices of «, which therefore is in 
contradiction with (i). Hence (ii) is valid. 

(ii) => (iii) need not be proved. We are going to prove (iii) -> (i). Assume that (111) 
holds. Since X(A)e.# } (1), it follows that X(4}=0. And since X(A) is an exit 
family, it follows that, for all 4 > 0， X(A) = 0. 

if y (å) satisfies the system of backward equations according to Theorem 2.12.1, 
it follows that F"(2)=0(aeH) in (2.12.2). Nevertheless when j is fixed, u; = 
1B,(Ae.@ 7} (1). By maximality of X (A), 4B, (A) < X (J), hence B;(4)= 0. Thus, 
(2.12.2) becomes ¥{A) = (A), that is, (1) is obtained. 

If there exists an honest Q process w(A) satisfying the system of backward 
equations, then by summing for j in the B condition of y{A), we find that Q is 
conservative, and the proof is complete. QED 


43 UNIQUENESS THEOREM: THE SYSTEM OF 
FORWARD EQUATIONS 


When the problem of uniqueness of Q processes satisfying the system of forward 
equations is taken into consideration, the system of equations 


(V,) jv —vQ =0 (1) 


will play an important role. Let us recall that the set of solutions vel of the 
equation (V,) is written as 7,, all non-negative solutions vel are denoted by 
L}, and the dimension of #; is denoted by n°. 


Theorem 1. (i) If the minimal solution is honest, or if it is a stopping process 
but n+ = 0, then the Q process satisfying the system of forward equations is 
unique. 

(ii) Suppose that the minimal solution is a stopping process and n* = 1. Then 
we have infinitely many Q processes that satisfy the system of forward equations, 
and only one of them is honest. 

(iii) If the minimal solution is a stopping process and n+ > 1, there exist 


infinitely many Q processes satisfying the system of forward equations, of which. 


infinitely many are honest. 


Proof. (i) When the minimal solution is honest, uniqueness is obvious. Let the 
minimal solution be stopping and moreover let n* =0. If y(A} is a Q process 
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satisfying the system of forward equations, by Theorem 2.12.1, it follows that 
F(AjeL 7 (ae H) in (2.12.2), u; = B (je $, hence F(A) = O(aeH), B,{A) = 0. 
Equation (2.12.2) turns into (J) = (å), that is, the Q process satisfying the 
system of forward equations is unique. 

(ii) Theorem 3.4.1 has described the construction. 

iii) The preceding part has already been answered by Theorem 3.4.1. Since 
n* > 1, it follows that we may select the exit family ja(A)e¥ ý (a = 1,2), so that 
#1(4), 7 (4) become linearly independent. Arbitrarily take two constants p° > 0 
(a = 1,2) such that 


H(A) = p A (A) + pà) #0 
For nl), there exists an honest Q process satisfying the system of forward 
equations according to Theorem 3.4.1. But there are infinitely many ways of 
selecting p° (a = 1,2} so that 4{4) is made different (constant factors not being 


considered). Therefore there exist infinitely many honest Q processes that satisfy 
the system of forward equations, and the proof is terminated. QED 


4.4 CRITERION FOR UNIQUENESS: 
THE HOU-REUTER THEOREM 


The criterion for uniqueness of Q processes is given by Zhen-ting Hou (1974) 
and summarized in his book (Zhen-ting Hou, 1982). In addition these discuss 
the existence of combinations of various cases and the problem of uniqueness, 
namely the so-called qualitative theory. Reuter (1976) has simplified the proof 
in Zhen-ting Hou (1974). Here the simplified proof of Reuter is adopted and 
further improved. 


Theorem 1 . Let a given matrix Q satisfy (2.2.6). Then for the Q process to be 
unique it is necessary and sufficient that the minimal Q process (A) is honest, 
or that it is stopping and moreover satisfies the two conditions below: 


(i) inf ZY, $,,(4), > 0 i>0 (1) 


ae + - . 
? n =Q, that is, the equation (V,) has no non-zero and non-negative solution 
vel. 


We point out that condition (i}implies m* = 0. In fact, by (2.10.14), (1) becomes 


sup( > X44) + zua) <l A>0 (2) 


i acH 


since, if X(A) #0, (2.10.21) holds. From (2) it necessarily follows that X (A) = 0. 
and hence m* =0. 
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Thus the condition (i) is equivalent to the following two conditions: 
(i,) m* =0 
{ii,) sup 》 Pig(Ald, < 1 i>0 


i aeH 


Proof of the theorem. Necessity: Assume that the minimal Q process is stopping 
and moreover the Q process is unique; hence a Q process of F type is unique. 
By Theorem 3.1, n* =0. Now let us assume that 


inf LY $,(4)=0 (3) 


According to Lemma 3.2 there exists a row vector « >0 such that [a, 1] = op 
and furthermore a@(A}el, and for this a, by Theorem 3.3.1, 


dete al) 
e+[a,Z —Z(A)] 


is a Q process where Z(A) = 1 — Af(A)l #0, c > [a, X°]. Since the selection of 
constant c may not be unique, it follows that the Q process is not unique. This 
is in contradiction with the hypothesis of the necessary conditions. Hence (i) ts 
valid. 

Sufficiency: Let (i) and (ii) hold and let (A) be a Q process. From (i,) it 
follows that, in Theorem 2.12.1, B(A} = 0; hence (2.12.2) becomes 


WA) = A) + Z(A)- (4) 


Wild) = bil) + 2 XAFA (5) 


acH 


If H is empty, from the formula above we know Ņ{å) = (4), consequently the 
Q process is unique. In what follows we suppose H # @. Substituting the formula 
(5) in the resolvent equation of y(A), noting that (A) satisfies the resolvent 
equation, and that because of Lemma 2.11.6, XA), aeH are linearly 
independent, we obtain 


FAAC, u) = FA) + (u — A p (F(A), X’) Fu) acH (6) 
eH 


Since F(A) > 0, ALFA), 1] < 1, it can be seen from the above formula that 
for arbitrary A, u > 0, F°(A)AQA, pel. Hence fix a and 4 > 0as well, and by (2.10.8), 
niu) = F(A)A(A, 2) (u > 0) is an entrance family. According to Lemma 2.11.3, 


niu) = a(t) + A) 


where a > 0 is independent of u so that gp (np)el and (i(1), 4 > 0) is a harmonic 
entrance family. By (ii) n* =0, therefore 4(z) = 0. Again since x depends on a 
and A, it follows that « = «%(A), Le. 


FNAL = NO) (7) 
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In particular when u= À, 
F(A) = a(A)(A) (8) 
On account of condition (i) 
1 > ALFA), 1] = ALe(A)A(4), 1] 
= [a"(A), Apt? M1] > n,[2°(A), 1] 


so that 
La%(A), 1] < 1/7. (9) 
Upon substituting (8) in (6) and observing (2.10.8) and Lemma 2.11.6, we have 
L= H + (DE Lotta), BADIM (10) 


or owing to the fact that (X“(A), à > 0) is an exit family, we have 
a(i) = alu) + 2 lA), XA) X Joys) (11) 
beH 


Because of (10), «*(4) decreases as J increases. Now let us proceed to prove that 
a%(A}) 0 Atco (12) 


Actually since both (A) and $(A) satisfy Q conditions it follows by (5) and (8) 
that 


lim y AX MAL AKA O(A)I; = 
à> aeH 
Hence 


lim AX? (2A)o (4)49 (A) = aeH 


A> ob 
By the continuity condition of (A), that is, 
did, ini as (A)d;; = 0 


taking i = a we obtain (12). 
Because, if A > u, by (9), 


2 [ae X% <> [o2(A), X (x2) Joel) 
< È [at Xu) elu) < x Ca (u), XADI Na 


beH 


< Eo » me I/ny < Ce"), UA /n, < 1/8 < oo. 
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Therefore (11} may be written as 


aA) +S E), Xp) J) = op) F, [os XA) 
beH 


beH 


and, moreover, when À — o, by using the theorem of dominated convergence 
we have 


O+ 2 [0, XJ = a(n) + 2 [0, 0jo(p) 
beH be 


Therefore xs( = 0 (ae H, u > 0). Thus F(A) = 0 (ae H, 4 > 0). Hence w(A) = (A), 
and so the Q process is unique. The theorem is proved. QED 


PART IF CONSTRUCTION THEORY OF 
BIRTH-DEATH PROCESSES 


In order to study further the construction theory of processes, it is very useful 
to study the construction of two kinds of special processes, i.e. bilateral 
birth-death processes and unilateral birth-death processes. The bilateral 
birth-death process that we consider is conservative; for the unilateral 
birth-death process there possibly exists a non-conservative state. The 
dimension of the solution space .Wi for the bilateral birth-death process is 
m* <2; for the unilateral birth-death process, it is m* <1. The birth—death 
processes are important because they have very important theoretical 
significance and application value. By studying them, many varied and deep 
results can be derived. More importantly, the study of birth—death processes is 
often the source that gives the ideas and methods for solving problems of general 
processes. 


CHAPTER 5 


Bilateral Birth—Death 
Processes 


5.1 INTRODUCTION 


If the state space E is taken to be the set of all integers, and Q = (q;,) has the 
following form: 


qu = 0 if|i—j|>1 


1 
qii- = 4; >0 Gite =, >0 qi = — qu = a; + b; j 


we call the Q processes bilateral birth-death processes. 

In this chapter, the Q processes will always refer to bilateral birth—death 
processes. The bilateral birth-death processes are conservative and, therefore, 
they surely satisfy the system of backward equations. | 

In this chapter the construction problem of the bilateral birth—death processes 
is satisfactorily solved. In other words, all the bilateral birth-death processes 
are constructed. The bilateral birth--death processes are looked on as diffusion, 
and the method used is the analytical method. The content of this chapter is 
derived from Xiang-qun Yang (1964b) 


5.2 NATURAL SCALE AND STANDARD MEASURE 
For Q of the form (1.1), we call 


b_ b_,b_ b_ b-b; 
zi = -al 十 一 -十 -十 二 et Hi< 一 
a; @_,@_, G_,;A_y°**'Gi+y 
Z_,=—b, Zo =0 Ži = do 
a, aa, @,4,°°°a;~ vies 
rea Od Ve Sa ae WSL ATE Sore eon ps hes SE ) ifi>} 1 
o( bi b,b, biba bi~; i 
the natural scale, we call 
i--—a i++ 
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the boundary points and we call 


eS ical pel a ifi< —1 
bob- b-a" Di 4 15; 
Ea l 1 ol 
di bob_, aobo AoA, 
pee ifi> (3) 


A941, Aq d;i- 14; 


the canonica} measure. 


5.3 CLASSIFICATION OF BOUNDARY POINTS 


The boundary points may be classified by means of the natural scale and the 
canonical measure. The boundary point r, is said to be 

(a) regular if r, is finite and J; > 94; is finite; 

(b) exit if r, is irregular but finite, and È;> 9(r2 — ZO is finite; 

(c) entrance if r, is irregular, but Ð; > 92:44; is finite; and 

(d) natural for all other cases. 


Similarly, rı may be classified. 


If we set 
R,= yA Zi — r)i = 之 (z; — Zi- 1) > Hj 
i<O i<j<o 
St = 一 > if; 
[入 站 
R,= > (r2 — 2); > (Z+: 2j) 2 Ej 
izoO 守之 人 O<jsi 
S,= > Zi fj : (1) 
izQ ' 


then we find that r, is finite when R, is finite; and that Ð; >o 4; is finite when 
S, is finite. Therefore, the above classification of the boundary points is 
_ comprehensive and, furthermore, if r, is entrance then r, is finite. 


Theorem 1. The boundary point r, is 

(a) regular if and only if Ra < «, S, < 0; 
(b) exit if and only if R, < ©, $a = ©; 

(c) entrance if and only if R, = 0, Sa < 0; 
{d} natural if and only if R, = %, S, = &. 
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_ Proof. Prove the theorem for a = 2. Obviously, 


R <r, 》 ji S, <r, 9, Hi: 
i20 


izo 


Hence if r, is regular, then R, < 2, S, < %. Conversely, if R, < 0, S, < a, it 
follows that r, must be finite by the definition of R,. Besides 


Lua (2+ Ry) < 


If r, is exit, by the definition we obtain R,< œ, Pizo; = %. From 
S,22,¥;>,4; follows $, = æ. Conversely, if R, < œ, $,= 0. By what is 
proved in the first section it follows obviously that r, is irregular. However by 
R,< œ it follows obviously that r, is finite. Therefore, r, is exit. 

If r, is entrance, by the definition we obtain S, < œ; owing to the fact that 
r, is irregular and according to what is proved in the first section, we surely 
get R, = oo. Conversely, if R, = «, S, < œ, then by what is verified in the first 
section it follows that r, is irregular. Therefore r, is entrance. 

By the proof of the above three sections it follows immediately that for r, to 
be natural it is necessary and sufficient that R, = œ, S, = œ, and the proof is 
complete. QED 


5.4 SECOND-ORDER DIFFERENCE OPERATOR 


Let u be the column vector on E, and define u* and D,u* as follows: 


ia tt ieE 

Zi+1 一 

je + (1) 
(D,u*), =+: icE 


Theorem 1. For an arbitrary column vector u, 


Qu=D,ut (2) 
that is, 
au; — (a; + bu; + bitigi = (Du); (3) 
Proof. Since 
1 
"r M E 
(z; — Zi- de; 
| 
(z; +1 7 Zi ) 
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f 
u; — H; H,— U; | 
+ i+l i È a | 
(Du wa (Es ip ete ) fu 
Zi41 72) 2 — 23-1 


= b (uj 4 | u;) = a;(u; a u; 1) 
= ių; -1 一 (a; + biju; T Bui 4 1 
and the proof is concluded. | QED 


it follows that 


Let u be a column vector; uu represents the row vector with components 
uju; Conversely, if v is a row vector, vu ' represents the column vector with 
components vu; ! 


Theorem 2. Assume that v is a row vector and u = vp“ !. Then 
vQ = (Qu)p | (5) 
Proof. By observing 
yb) Hy =, ar = bi (6) 
we see that 
(Qu); = aw; ip 一 (Qi 十 bp 十 Di 
一 本 (人 十 bp + 0,, iei” 
= [v;_ bi; vla; + b)+ iga Ar 
= (vO ' QED 
Corollary 


Suppose that u and f are column vectors, and that v = up and g =f u. Then u 
satisfies 


-or 


Qu =f (7) 
or 
Au—Qu=f 4>0 (8) 
if and only if v satisfies 
vQ =y © 
Àv — vQ =g (10) 


Lemma 3. The solution of the system of equations 
u= fi 
Quy 一 t — (a, + bu, + bys 17 —f, 


Un =Sn 


i<k<n (11) 


SOLUTION OF THE EQUATION Zu - Du’ =0 9] 
is 
E a et f k Z kl z ZE gens 
Se a Dd, (aj —2)hjyt "= LE n= Sy) Fit; 
Sn ŝi on Zi Zą— Fy j=it+d on 一 Zi jk 
| (12) 
Proof. By Theorem 1, the system (11) of equations becomes 
u =f; 
uj — uš = — fita i<k<n (13) 
Un =f, 


By the above expression we obtain 


and from this we get 
k-1 k-1 
Ux = U; + > (44, — u) = u; + 3 uy (Zipi — 2) 
=i {=i 


k-1 
=u;+ 2 We (2144-2) — pi a > Siu n Jeies— Zi) 


isi \j=i+1 
k-1 上 一 上 
=f, + ui (2, — 2) 2 ae a 2 JuZa ~ 21) 
Therefore 
k-i 
u, =f; + uj (24 ~ z) — F (2, — Zi) ik (14) 
j=it) 


In particular, if k = n, we have 


Zn 一 z) SiH; 
so that 


+ no vi ] o 
i See N È (Zaz) Sih; ua 


fn — Ži Zn™ Zij=i+1 


Upon substituting (15) into (14) and rearranging it, we obtain (12), and the 
proof is terminated. QED 


5.5 SOLUTION OF THE EQUATION iu 一 D,u* =0 


Theorem 1. Let u and v be two solutions of the equation 


du~D,u* =0 A>0 (1) 
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Then 


W(u,v)=u*e—uv* = constant 


Proof. First note that for arbitrary vectors s, t 


Sti— Ssti- 1 = Sli 6-1) + fi-s — Si- 1) 
= Silti —f;-,)+ t(s; — 8;-1) ` 


so that 


[D,(st)]; = s(D,0): + ti- 1(D,s); 
= s,_,(D,t); + ti(D,s) 
Therefore 
D,W(u,v) = D (u* t) — D,(ue*) 
= bi( De ) + Wi (De; 
+ ui(D,r j ); = vi (Dati) 
= Apu, + u} (Dpt) — Aue, — vi (D4); 


u; Zi — Zi- uj 


J.-—-27, 
<i i-1 


=0 


Equation (1) can be rewritten as follows: 


+ + _ 3 < 
u’ —uj_ = ÀU;Hi 4>0 


L 


Consequently if u is a solution of equation (1), then fori>0 


u = Uy 十 2 (u; uy 1) 
k=1 
i 
=ug +À } uty i>0 
k=) 


i—1 
u; = Uo + y (ya — Ue) 
k=0 


i—i 
= uo + 》 uy (Zk+ — 24) i> 0 
k=0 
Substituting (5) into (6) and rearranging, we obtain 


i-1 
U; = Uo + ug (zi Zo) + AY ug(zi— Zk i>0 
k=1 


Wi a Ne i. 


(2) 


(3) 


QED 


(4) 


(5) 


(6) . 


(7) 


th mp 


WT ease one ot 


yea ST Hr ane Sam Arma a ae ane Gee cag meeta am tnm e te 
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Similarly, for i < 0 
u =u —A Uhl, i<0 (8) 


U; = Uo — Uo (Zo— Z) +Å > 


it+ti<h<0 


Uy(Z_ — Zi Hr i<0 (9) 


Conversely, arbitrarily fixing the values of ug, ug, we can determine ui, ui, 
‘Uz, U2 ,..., by (5) and (6); similarly, we can determine u_,, u*,, Una, u*,,.... 
Obviously u determined in this manner is a solution of equation (1). 

Given uo = 1 and ug =0 the solution of equation (1) is denoted by v. Given 
uo = 0, uj = 1 we denote the solution of equation (1) by s. From (7) and (9) we 
can see that v; and s; are positive and strictly increasing as 0<if + oo; and 
that v; and — s; are positive and strictly increasing with increase of the absolute 
value of i, as 0>i] — æ. Moreover, by Theorem 1, 


W(s, v} = 55 vo — Sovg = 1 (10) 
Lemma 2. When i > 0, 
v,/s; > DA 


Proof. 


See Sina QED 


Lemma 3. 0,/s; is strictly decreasing as 0 < if + œ. 


-(@1-4) 
Sisi Spf Zi+i — Zi 


0 QED 


Proof. 


Lemma 4. vt AS is strictly increasing as 0 <if + œ. 


Proof. 
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— Pat") = vi Das) 


ssh 

_ AL(s? ~ Asi — (vr — Aw)si] 

Si Si 1 
AW(s, v) A 

or St SO) ED 
S Si S Sia j i 


Lemma 5. Assume that u is a solution of equation (1), and that u; is positive 
and strictly increasing as 0<if+ œ. Then u;* is also strictly increasing 
as O<ift+oo. u(r,)=lim,;,,.u;< 00 if and only if r, is regular or exit; 


u*(r,)=lim;.,,u,; < œ if and only if r, is regular or entrance. 


Proof. From (5) it can be seen that u;* (i > 0)is positive and strictly increasing. 
Suppose u(r.) < œ. By (7} we have 


t~1 


u; > Aug >: (Zi — 2} Hx (11) 


k=] 
We see R, < œ as i> + œ, that is, r, is regular or exit. Conversely, assume 
R, < œ. By (5) 
i 


Hi+l TUK ug (Zi+1 — Z;) + Auf2;41 — Z) bY Hy 


k=1 
A i 
u. u 
liye {za — 2) + Alzi — 2) X Hk 
u; Uo kad 


The right-hand side of the above expression is the ith term of a convergent 
series, so that $; oiog(u;,;/u;) converges. Thus lmi +H; < %0. Suppose 
u*(r.)< œ. By (7) we have u; > us zi. Therefore, by (5) 


i 
+ + + 
u; > Uy 十 Uo > Z Hk 
k=t 


Therefore s, < œ, that is, r, is regular or entrance. Conversely ifs, < œ, by (6) 


+ i = t he 
U; < Ug + Uj (Zi — 29) = Uy + UY; 42; 


so that 
uy — uj, = ÅU; < Augu, + Auz 24H; 
+ 
u; Au 
-i 1 Sut Az, 
uii 0 


Oh oor tena REPRO TE Tr at R a = = 
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Since s, < © implies Yj. 54; < %, it follows from the above expression that 
Dizolog(u;/u;_,) converges. Therefore, lim,.,,.u;> <æ, and the proof is 
terminated. QED 


Lemma 6. When 0 <if + œ 


ifr, is not regular; 
c>0 ifr, is regular. 


Proof. It can be deduced from Lemmas 2 and 5. 


By Lemmas 2 to 4, we can set 


+ 


i> ta Si i + oc Si 
Moreover, 0 <8. @=6 if and only if r, is irregular. QED 


Theorem 7. For u to be a positive strictly decreasing solution of equation (1), 
satisfying the condition uw) =1, it is necessary and sufficient that u has the 
following form: 


u =v — 0s (13) 


where 0 < 0 <0. If r, is regular, then there exist infinitely many solutions stated 
above and they are between u=v— 6s and ü= v — s. If r, is irregular, the 
above mentioned solution u is unique. 


Proof. Since v and s are two linearly independent solutions, it follows that 
every solution u is a linear combination of v and s, so that the solution u 
satisfying uo = 1 must have the form (13). 

Suppose that u is a strictly decreasing positive solution, then u = v — 0s > 0, 
u* =v* —8s* >Oand, therefore, 0 < 0 < 0. Conversely, if 0 <8 <, then u; > 0 
and u, <0 for i>0. That is, u is positive and strictly decreasing in i >Q. In 
i <0, since v and (— s) are positive and strictly increasing with the increase of 
absolute value of i as O>i|— œ, it follows that u is positive and strictly 
decreasing on E, and the proof is conctuded. QED 


Lemma 8. For u,u and a in Theorem 7, 


0 
aks | 1/s*(r2) 


ed 
m={ i, 


ifr, is exit or natural; when r, is regular u(r,)=0 

ifr, is entrance; when r, is regular, u(r.) = 1/s* (r3) 

ifr, is entrance or natural; when r, is regular, u*(r,)=0 
ifr, is exit; when r, is regular, u*(r,) = — l/s(r,) 
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Proof. When r, is exit or regular, by Lemma 5 we have t(r2)< %, (hr) < KH. 
Therefore, u(r} = v(rz) — Csr) = 9. 
When r, is regular, 
° v(rz)s*(r2)— r (rasla) 
有 IE 


S (rz) 
1 
sr 
When r, is entrance or natural, by 
D 1 
m =m; =v; — OS, Sb — ot $i 二 ot 


If r, is natural, then since s*(r,)= æ, it follows that ulra}= ur) =0. If r3 is 
entrance, then 
u(r) = u(r) < l/s (ra) 
For an arbitrary ¢ > 0, when i is sufficiently large, 
ulr) + E> 0, — 4s; 
Upon fixing i, when j( > i) is large enough, 


vt 
ulr) + e> 0 4 


But when j is fixed, 


+ + + + + 
) v? v 1 
=s) =o Lst=| t i js; <0 
,+ i +i sé os 
Sj J j i j 
so that vt i i 
u(r,) +e >0,--5;=-~ 7 
i t n s7 s*(r2) 


Since « is arbitrary, u(r} > 1/s* (r2). Therefore, when r, is entrance, 
u(r) = 1/s* (r2). 
The proof for u*(r,) is similar and can be left out. The proof is SR z 


Theorem 9. In equation (1) there exist a strictly decreasing positive solution 
u,(4) and a strictly increasing positive solution u,(4} which have the following 
properties: 

(i) ut (A) <0 is strictly increasing; uj (A) > 0 is strictly increasing 


us (A)u,(A) — uz(A)u? (2) = | 1>0 (14) 


amyn = TET | DR UA YY ENS CQ = ae = 
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(ii) ualra 4) = liM p, alà) is finite if and only if r, is regular or exit 
Ug (Fa 4) = Hm., n, Ua) is finite, or equivalently Dual < oc if and only 
ifr, is regular or entrance. 


(iii) If r, is not entrance, then u,(r,,2)=0 (b €a). If rs is entrance or natural, 
then u,*(r,, 2) =0 {b £a). 


Proof. By Theorem 7, it follows that the strictly decreasing positive solution 
u,(A) of equation (1) exists; similarly, the strictly increasing positive solution 
u>(4) also exists. By (5) and (8) it can be seen that both u? (å) < 0 and uz (A}>0 


are strictly increasing. Obviously, W(u,(A), u,(4)) > 0. And (14) is satisfied after 
properly normalizing. 


We shall prove (ii), (iii) for = 2. By Lemma 5 we deduce (ii). However, 
AY ua Ais = u3 (ra 4) — ui (ra A) (15) 
Obviously, uz (r,,4) is finite, therefore, that ut (r,, 4) is finite is equivalent to 


Lita(A)u; < oc. By Lemma 8, u,(A) and u,(A) can be selected such that (iii) is 
satisfied and the proof is complete. QED 


Theorem 10. Both u,(A)u and u,{A}u are two linearly independent solutions of 
the equation 


(V,) dv ~vQ =0 A>0 (16) 


Each solution of the equation (v,) is their linear combination. 


Proof. This proof follows from the corollary to Theorem 4.2. QED 


5.6 MINIMAL SOLUTION 


From now on, we shall denote the solutions of Theorem 5.9. by u,(A) and u,{A). 
Set 


wu if SJ 
(=? LINAJ 
cue ee ifi>j 四 
Then 
Hi; ;(A) = Hj P(A) (2) 


Let f be a column vector, and g be a row vector. Then 


LOO BDF =a uf tu E uf B 


J>i 


i<j 


[gP(A)]; = 3 gitA) = uy (A)u; > Gitta (A) + uy (A) pL; 2 Gis {A} (4) 
i j i>j 
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If g =f u, then 
gPlA) = 92 J | (5) 


Theorem 1. The equation 


ulh) uA) (6) 
u(r1, A) ualra A) 


Ay (A) =1— 
holds. (If u,(r,,4) = oc, then the corresponding term in (6) is understood as zero.) 


Proof. By (3) and (5.4) 


Ay’ $;(A) = u,{A) 2 Aug (Ah; + U>;(A) > Au, (ADB; 
j jsi j>i 


jsi j>i 


= uml) Lad — D+ ual) D uA) uiy- A] 


= u, (A) [uzl z u3 (Fi, Ay] + ua (Aus (r2, A) 一 39] 
= u(A)u;{A) — uz,{A)u 1 (A) 3 uy (Aus (ry, A) + u>(Auy (ra A) (7) 
If we can prove 
] 
+ (Cr 人 一 一 一 一 一 ， u3 (ri, A) = — = (8) 
da EAT n 
then by (5.14), follows (6) from (7}. . . 
We prove only the first expression of (8). In fact, if r, is entrance or natural, 
by Theorem 5.9(ii), (iii), we obtain u(r, 4) = œ, uy (ra, 4) = 0. Therefore, the first 
expression of (8) obviously holds. H r, is regular or exit, by (5.14), we only need 


prove 
lim u,(A)uz{A) = 0 (9) 


When r, is regular, obviously the above expression holds since uy (r2, 4) < %, 
u,(r>,4) =0. When r, is exit, since tlr2 4) =90 and u3 (A) is increasing, — uy (A) 
is decreasing, it follows that 


0< uy (A)uz(A) = u5(A}Lu (A) — u(r2, 4)] 


=uz(4) È E-un — 24) 


jži 


< ut ¥ ulz — 2) 


jži 


ET TT er 


rT Wr we 
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= ~ uri(W [ualra 4) — u2AA)] 
ur (ra, AEU (r2, 4) — uara, A)] 
=0 (zi 72) 


and the proof is terminated. QED 


Theorem 2. If fem, gel then o{A) fem, gd(A)el and 
AAS — OLHA =S A>0 (10) 
Ag@A) — Laod] =g A>0 (11) 


Proof. By Theorem 1 we can get that $(4}f em, gġ{2)el. On account of (5) and 
the corollary to Theorem 4.2, we only need to prove (10). In fact, by (3) we have 


[$F = ur (A) > uA) fs H; 十 uz (A) > uy (ADS Hy (12) 


jsi j>i 


D Leafy; = Du) >: Uy fA) f ju; 十 D,u3 (A) Ds u (ADS ju; 


gsi 


+ [ut (Aura) — uy, Auta 


= Au,;(A) 2 Uz (A) fihi + Apa fA) oy uy A) fH; 
<i j>i 


ai [uz (Au, (A) = uy (Ajur (Alf; =APASI: Si QED 


Lemma 3. Let fem and r, be regular or exit. Then 


LOA sf Ira) = lim [ġ(4) f] = 0 (13) 


Zi fa 
Proof. Since u,(r,,4)< œ when r, is regular or exit and 


Ug(A) 


一 一 ] u,;(A) 0 (b +a) (14) 
uala À) 


as Zi 一 ro by Theorem 1, [¢(A4)1]}(r,) = 0. Equation (13) follows from this. 
QED 


Theorem 4. (4) is the minimal Q process. For $(4) to be honest it is necessary 
and sufficient that both r, and r, are entrance or natural. 


Proof. (A) 20 is trivial. The norm condition follows from (6), and for the 
equality of (6) to hold it is necessary and sufficient that both r, and r, are 
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entrance or natural. From (10) and (11) it can be seen that the B condition and 
F condition for 由 (4) hold. 

Let fem and set F(A) = o{A)f. By Theorem 2 it follows that F(A) — F(t) + 
(A — wo(AF (em and is the solution of equation (5.1). Therefore, it is a linear 
combination of u (å) and u,(A), that is 


F(A) — F(a) + (4 — OA Fe) = cu (A) + Cual À) i15) 


where c, and c, are constants. 
If r, is regular or exit, by Lemma 3, letting z;—>r in (15), we obtain 


O= cu, (rz, 4) + Caull À) = €2U9(F2, À) 


Therefore, c, = 0. If r, is entrance or natural, since u2(r2, 4) = 00, u, (72,4) < © 
and the left-hand side of (15) is bounded, then c, = 0 follows, too. Similarly, we 
can prove ci = 0. Thus (15) becomes 


F(A) — F(u) + (A — dF) = 0 


Letting f; = ô; we find the above expression becomes the resolvent equation 
for P(A). 

Thus (4) is a Q process satisfying the system of backward and forward 
equations. Next we proceed to prove the minimality of P{A).. 

Let (4) be a Q process. Since Q is conservative, and ¥(A) satisfies the B 
condition, it follows that, for fixed j, (4) — @:;(4) Is a solution of equation 
(5.1), so that 


pyl) — P(A) = yu, (A) + Catal) (16) 


where c, and c, are constants independent of i. 
If r, is regular or exit, by (A) > 0 and Lemma 3, after letting zi 一 六 in (16) 


it follows that c,u,(r9,4) + C2ta(rz, À) = C242(r2, 4) > 0. Therefore, c, 20. If r2 is 


natural or entrance, then the left-hand side of (16) is bounded; but u(r, 4) < %, 
u,(r,,4) = œ, and it follows that c,=0. Therefore, we always have c, 20. 
similarly, we can prove cl 2 0. Hence (4) > ¢(4), and the proof is complete. 


QED 
5.7 SEVERAL LEMMAS 
From now on, we shall simply write 
nae aga (1 
(71,4) Wa(r2, À) - 
x} 5 razi x? 三 ti Ft (2) 
ry 一 ry F2 Fi 


FR EIR er TR E I REED Pa er re oT zau 
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i ee: Fa iS one or exit, X°(A) # 0. When r, is entrance or natural, XA) =0 
ri is finite, and r, is infinite, we shail define X' = 1. If r, : infinite, 
ALEE car r, and r, are infinite, 


We can make similar comments for X*. X° is a soluti 
; tion of eguat .11. 
Equation (6.6) becomes arene 
Apli) = 1— X'(4)— X? (A) (3) 
Lemma 1. Xie.Ai (1)(a = 1,2) are exit families, and 


Ad(a)X4 = X*— XA) a=1,2 (4) 


Proof. Obviously, x *(A)e.M; (1). From (4) and the resolvent equation for (å) 
we know that X°(4) is an exit family. Next we prove (4). 


Obviously, if both rı and r, are infinite, then of course (4) holds. If r, is finite, 
and r,(b # a) is infinite, then X? = X°(i) = 0, X° = 1, and (3) becomes 


. iol = 1 — X%() . (5) 
Therefore, (4) holds. 
Ifr, and rz are finite, it suffices to prove that (4) holds for a = 2; (4) fora =} 


can be proved similarly. By (6.3) 


+2 Qilar aes z;) =u, ,{A) N Aua (A); = (Ze+1 — %) 


jsi kj 


+ uy {A) Apes (Au; X (Zk+1 — 2) (6) 


j>i k2j 


The first term on the right-hand side is given by 


4, {A) 2 Aia E (Zk+1 — Z4) 
>j 


fst 


= TIP (Zea — Zy) 2 Auta (A) Mu; + X (zk+ 1 一 Zy) > in, (A) 
i je k>i jei 


= ma( (zx+ 1 一 z,)[u3,(A) = TE À)] 


k<i 


+ 2 (Zk+ 1 — Z) Euz,(A) — uz (Fis an) 


kži 


a (A ml — u(r, A) + us fA)(rs 一 2 一 2 esi = aduz) 
k 
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The second term is given by 


Mail4] ui(A) > (2,41 — =) 
i>i 


kj 
) 2 AU Hj 


= uzi(4) > ( Zk+1™ 


k>i <j 

= uz,(A) > (2,-;- zy) Lu, (A) ii uy (A) ] 
k>i 

=A) È (rsi — 2) Ley, (A — f(A] 
kži 


= ul Aiu (i A} — uy fA) — ur (Ars —2z;)] 
= u,(A)[— u, (A) — u Ara —z;)] 
Hence substituting them into (6) and noting (5.14), we obtain 


sy (Ar, = z;) = (r3 — 2) — 8, (A)uz(r,, A) — uzil Ar — ri)uz (rs, A) {7) 
i 


Since r, being finite implies that r, must not be entrance, it follows that 
u,(r,,4)= 0. Again noting (6.8), and multiplying both sides of (7) by (r3 — rı), 
we find that (4) holds for a = 2, and the proof is finished. QED 


Lemma 2. Let r, be entrance and r, be regular or exit. Set 


uy (Ads; 
= {r3 — ZH, (= 一 8 
Hij {r2 z 11 ;( ) ut (r, A) ( ) 
Then 7,(AjeY; is an entrance family and moreover 
An, P(A) = ni — 1 (A) | (9) 
Proof. By the corollary to Theorem 4.2 we obtain (A)e i.Ifwecan prove 
| 
t A= e {10 
12(r1, À) ut (ri l ) 
then by (7) and by noting (6.5), we obtain (9}. 
To prove (10), by (5.14) it follows that we need only to prove 
lim [u,(Aus(a)] =0 (11) 


Since u; (rı, 4) = 0, it follows that 
0 < uy (A)uz (A) = uy (Aug) — up (ry, )] 


= uy ,(A) 之 Aus (4 AD; 


FR a Ne OE TE ET NR AE! Miah Pe 


Se ey T 


ee i u 一 一 人 rr 
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< Wi(1) > Au (AD; 
ji 


= (NLA(D— uf (r,,4)] 70 (z; >r) 


That is (11). From (9) and the resolvent equation for $(A) it follows that n,(2) 


-is an exit family, and the proof is complete. QED 


Lemma 3. Let r, be regular or exit. For the entrance family 7(Ae LY} (4 > 0) it 
is necessary and sufficient that 7(4) has the following Riesz representation: 


AlI) = py P(A) + pX? (Ap (12) 
where the constant p, > O(a = 1,2), p, =0 if r, is exit or natural, and 


n Jf) 
es eee 


: F; is entrance (13) 
ifr, is regular 


Proof. By Theorem 5.10 it follows that #(A)e “> has the form (A) = c rati (Aly + 
C2,U2(A}u. Since 4(A)el by Theorem 5.9(ii) it follows that c,,=0 if r, is exist or 
natural. Therefore, 4(A) = p,,®,(A) + p.,X*(A)u and, moreover, p,, =0 if r, is 
exist or natural. Because X*%(A) is an exit family if r, is regular, so X%(A)y is an 
entrance families. Now that (4), (A), X7(A) are all entrance families, it follows 
that p,, = Pa is independent of 4. Hence (4) has the representation (12). Since 
n(A) > 0, by Theorem 5.9(iii) we get p, > O(a = 1,2). Conversely, it is clear that 


(A) given by (12) is an entrance family, and (We LY}. QED 


Lemma 4. Let r, and r, be regular or exit. If r, is regular then 


ah -一 a b ab _ + 0 ifb=a 
Ut = AEX (m X*] TU a na (14) 


as AT œ. 


Proof. As in (2.11.46), we can obtain 
U$ — U? = (A — wv) [X iu, X°(A)] (15) 


Thus the monotonicity of U% is proved. Next we might as well suppose that 
r, is regular. By (4) and (6.12), 


[Ap] = hui) 3 3 (AVX pe; + Aula) È u (AXP; 
ji 
— 1} 
aaa [Xt] (16) 
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Letting z; >r, we obtain 


= b 
-U?= ESA SA iea) (17) 
2 


where 


X?*(r,,A)= lim [X?(A)]* 


tT ah a | 


To prove (14), we only need to prove 


lim X?+*(r,,4)= + 00 (18) 
Ato 
lim X'*(r,,4}=0 ; (19) 
A> 加 


Since both X7(A) and [X2(A)]* are increasing functions, it follows that 
2 _ y2 
SEN e 


By (2.11.29) we have X°(4)Ļ0(4f%,a = 1,2). From the expression above, we 
obtain 


< lim X?*(r, A) 
r2 — Zi Azo 


Letting z;— 7,, (18) follows. Furthermore, 


XA) Xt 
0< —X'(r,,4)< — [x4 = 20s 
21 — žo 
Then (19) follows by X'(4){0 again, and the proof is complete. . QED 


Lemma 5. If r, is exit or regular, then the standard image of X°(A) is X". 


Proof. We shall prove the lemma for a= 2. Since X?(A) < X?, the standard 
image of X7(A), X? is < X?, so that 


Ap(a) X" = X? — X7(2) . (20) 
Moreover u = X? — X? isa solution of equation (2.11.18). By (4) and (20), we have 
ip(Au =u (21) 


Let r, be infinite. Since r, — z; and z; are two linearly independent solutions of 
Qu = 0, it follows that 


u = C (f2 — Zi) + C27) = Cyr 2 + (C2 — €1)2; 
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Since the left-hand side is bounded, surely ci =c,. Thus u=c,r, and, 
Ap(Aju = cyr,Ap(A)l = certl X? = u — yr, X7(A) 


Comparing (21) it follows that c, = 0. Consequently u = 0, X? = X?. 
Let r, be finite. Then u=c,X'+c,X?, since X! and X? are two linearly 
independent solutions of (2.11.18). By (4) and (20) we derive 


Ap(Aju = u — c, X14) — ce? X?(A) 
Comparing (21) we have 
c,X'(A)+¢,X7(A) =0 


If r; is exit or regular, then c; =c,=0 and hence u = 0; if r, is natural (r, 

cannot be entrance because ri is finite) then c, = 0, so that 0<c,X} =u, < X?. 

Letting i — œ we have cl =0. Therefore u = 0 and the proof is complete. 
QED 


5.8 ONE OF r, AND r, IS ENTRANCE OR NATURAL, 
THE OTHER IS EXIT OR REGULAR 


From this section on, we shall construct all Q processes. By Theorem 6.4 it 
follows that if both r, and r, are entrance or natural, then the minimal solution 
(A) is honest, so that the Q process is unique. In this section, we suppose that 
one boundary point is regular or exit (for example r,), and that the other 
boundary point is entrance or natural (say, r,); whence u,(r,,4)= 0, 
lz(r2,4) < co. Hence equation (5.1) possesses only one linearly independent 
non-null non-negative bounded solution X(/) = X (A), that is, the dimension of 
Ni, m*=1. In this case, the construction problem is already solved by 


- Theorem 3.2.1. Certainly, we take a relatively special form in the present case. 


If we denote c — [a, X°] — 6° of Theorem 3.2.1 by z, then 
c+ [a, X — X(A)] + alā), X] 
=¢ + [a, X? + X —X(A)] + A[p), X? + X] 
=č + [x,t — X(4] + Ala), 1] (1) 


In addition, if we also rewrite ¢ as c, then Theorem 3.2.1 now takes the form 
below. 


Theorem I. Let r, be entrance or natural, and r, be exit or regular. For vw (2) 
to be a Q process it is necessary and sufficient that either w(2) = @(A) or w(A) 
can be obtained as follows. Take a row vector a > 0 such that a@(A)e/ and select 
constants p, > 0 (a = 1, 2) and, moreover, p, = 0 if r, is exit or natural. According 
to (7.12) take (A) satisfying 


n{A) = ao(à) + 4(A) #0 (2) 
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Take a constant c > 0. Finally, set 


g ¥ Eh a (3) 


c+ [o 1 = XD] + ALAA), 1] 

For the process (å) to be honest it is necessary and sufficient that c = 0. For 
the process (A) to satisfy the system of forward equations it is necessary and 
sufficient that « = 0. 


Wiha) = puli) + X; 


5.9 BOTH r, AND r, ARE REGULAR OR EXIT: LINEARLY 
DEPENDENT CASE 


In this section we suppose that both r, and r, are regular or exit; whence 
non-null X“(A)e.Mj (1) (a = 1, 2) are exit families. Let y(A) be a Q process. Since 
both w(A) and (A) satisfy the B condition, thus for fixed j, w,,(A) — ġ;;(4) is a 
solution of equation (5.1), so that 


Vil) = BoD + XIV) XAFA (1) 


Letting z;>7r,, we obtain F(A) > 0. 
We shall determine F(A) (a = 1, 2) so that w(A) of (1) is a Q process. We only 


need consider the norm conditions and the resolvent equation because (A) in . 


(1) satisfies the B condition. 
Because of (7.3) and by observing that X%(r,,A)=1, X*(r,, 4) =0(b # a), we 
can easily see that the norm condition of #( is equivalent to 


F°(4) 20 ALF*(A), 1] < a=1,2 (2) 


Since (A) satisfies the resolvent equation, upon substituting y(A) of (1) into 
the resolvent equation, noticing that X%(A) (a = 1,2) are exit families, and noting 
their linear independence, we find that the resolvent equation for w(A) is 
equivalent to 

2 . 

FDA v) = Fv) + (v— A) CFA), XO) IF?) a=1,2,A,v>0 (3) 

b=1 

To begin with we suppose that F'(v), F?(v) are linearly dependent for some 
v > 0, that is, 


Fv) = myn(v) m,, 20, (v)20, a=1,2 (4) 
By (2.10.8), multiplying both sides of (3) from the right by A(v, 4), we have 
È [F*(4), em lol A) . 


=1 


P= (me + v—À 


Therefore, ee (a = 1,2) are linearly dependent for arbitrary 4>0. Thus (4) 


holds for ali v > 0. 


eg ee Ps NA eee 
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On account of (2.10.8), under (2) and (4), (3) is equivalent to 
F(A} = maan (à) 


n(A) (4 > 0) 


quantities m,, 2 0, row vector 7(A) > 0 (5) 


are entrance families (6) 


2 
Mar = May + — A) 2 mayLn(A), XO] Ma 


之 a= 1,2 (7) 


By (7), if m,, = 0 for some a and some å > 0, then m,, = 0 for atl à > 0. Hence 
either m,,=m,,=0 and then Ņ(4)=Ņ(å) which is trivial: or nts) #0, 
m,, +m, >0. We discuss the latter case. By (6) and Lemma 7.3. 


nA) = ald) + py X ' (Au + pX? (Au 40 (8) 


where constant p, > 0 and p, =0 if r, is exist; the row vector a > 0 is such that 


ap(A)el. Next, by (7) we derive m,,m,, = m,,m,,. Therefore, there exist constants 
d, > 0, d, +d,>0 such that 


dimz, = dM; (9) 


We may as well suppose d, >0 without loss of generality; hence m,,>0, 
whereas (7) becomes 


2 


2 È d, Entà), X” Jm, 


dym,,=d,m,, + (V — 


Dividing the above formula by m,,m,,, we obtain 


dym;, =dym,' +(v— ay a,[(n(A), X°(v)] (10) 
Owing to (2.11.46) we have 
(v — A Enli), X°(v)] = vEt), X°] — AEn), X+] (11) 
Therefore 
| 2 
d,m;; 一 之 d àll), X°] =c (c is constant) (12) 


From (9) it follows that 


Mai = d(c + > dA [Ln(4), x) 
b= 


By substituting (5) into (2) and noting that X! + X? = 1, the norm condition 
becomes 


=I 


a=1,2 (13) 


(di —d,)A[n(A), X*] <c 


(d, —d,)A[n(d), X'] <c (14) 
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The equalities hold if and only if d, = d}, c =0. By (8) and (7.4), we have 
2 
iLn(2), X°] = Afap(A), XJ + 2 pX Aa, X"] 
b=1 


= [a, X*— X°A)] + p, U3" + pa UZ 
Since X“) L0({åf co) and on account of (7.14) 
an X11 W, = [XJ + p,U'+p,U% ifo (15) 
By (7.14) W, is finite if and only if 
[a, X] < oo Pp, =O (16) 
and then 


W, Sex] (b +a) (17) 


rz — Fi 
Therefore, (14) is equivalent to 
c>0 ifd; =d; 
c 2 (d, — da) W2 ifd; >d, i (18) 


Theorem 1. Suppose that both r, and r, are exist or regular and that F(A) 


(a = 1,2) are linearly dependent for some (hence all) 4 > 0. 

For y(A) of (1) to be a Q process it is necessary and sufficient that either 
W(A) = o(4) or yn is obtained as follows: Select constants d,20,d,+d,>0, 
pa 2 O(p, = Q ifr, is exit); take a row vector a > 0 such that a@(A)ef and moreover 
(8) holds. It is also required that (16) holds if d,<d,(b# a). Choose a constant 
c satisfying (18) (where W, is the same as in (17)). Finally, set 
[d Xi (A) + d,X7(d)] DILAT + PiX} {A)pe; + paX7(Wp] 


c+y2, d, { [a X°— XPA + ALP X Au + pX? (Du, X°)} 
(19) 


W (A) = $i (A) + 


For the process Ņ(4) to be honest it is necessary and sufficient that d, = d3, 
c =0. For this process to satisfy the system of forward equations it is necessary 
and sufficient that x = Q. 


5.10 BOTH r, AND r, ARE REGULAR OR EXIT: LINEARLY 
INDEPENDENT CASE 


In the previous section, we assumed that F%(4) (a = 1, 2) were linearly dependent. 


In this section, we suppose that F%(A) (a = 1,2) are linearly independent. 


a 


Be ET eb re a = 


TRE EE Er TEE AEE RETEA tS TCA TO TAS! = A TN TNE 
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It will be convenient to use matrix notation. We write 
bY =O) 


where y? and y? are quantities or vectors. If y*, v (a= 1,2) are vectors, the 
symbol { [y, v]} will denote the second-order square matrix whose elements are 
[y*, 07]. The second-order identity matrix will be denoted by J. 

Using these notations, (9.1), (9.2) and (9.3) may be written as 


WA) = P(A) + [X(T TF(A)J (1) 
[F(4)] > [0] {ACF(A), XI} E1] < [1] (2) 
LF(AA(A v) ] = [FO)] + & — ALFA) XE (3) 


Lemma 1. Let y(4) be a Q process having form (1}. Then there exist two row 
vectors x° >0 (a = 1,2) such that «*@(A)el, and there exist two second-order 
square matrices #, = (r4’) > 0 and .@, =(M%) > 0 (M}\4 = M?* = 0 if r, is exist). 
Moreover, 


LF(A)] = HL) + -ALX u] (4) 


Proof. Since w{A) is a Q process, (2) and (3) hold. 

From (2) and (3) we can see that for arbitrary 4,v > 0, LF(A}A{/, v)] > [0]. 
Now fix, for the moment, a and A>0 and set n(v) = F(A) Alh, v). Then nf{y) is 
an entrance family. Hence, by Lemmas 2.11.3 and 7.3, there exists a row vector 
BS 20 independent of v (but dependent on a and A), such that fo d(Ael. 
Moreover, 


vF*(A)A(A, v) — FAL v)Q = Be (5) 

F°(A)A(A, v) = B300) + MUX Au + MP X(N (6) 

where M, = (M4) > 0 is independent of v and M!° = M?*=0 if r, is exit. In 
particular, when v = A we have 

AF*(A) — F°(A)Q = BS (7) 

CFA] = (BOA) + AEX Au] (8) 


Therefore, we should like to prove the following. There exist two row vectors 
a? > 0 (a = 1,2}, independent of A, such that 


. Bi = rila! + ria? (9) 
where #, = (r3) >0. Then substituting (9) into (8} we obtain (4), and from 
BS b(Ajel we can deduce «*(Ajel (if ri? =r?” =0 for some b, then we can take 


ob to be 0 independent of the value of pi. If we can prove this, the lemma is 
thus proved. 
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By (5}and (7), multiplying both sides of (3) from the left by (vf — Q) we obtain 

[Ed = CE] + O AFA, XI BI (10) 
From this we can see f4] (àf), and if f° = 0 for some å > 0 and some a, then 
p! = 8? =0 for v > 4; whence f! = 8} = 0 for ail A > 0. In this case, (9) is trivial, 
we only need to choose a! = a? = 0, #2, = 0. We assume f% #0 (a = 1,2) for all 
A> 9. Set 

F,,=1+(v—A{ LFA), X(v)}} 


its elements being 14°, and then (10) can be rewritten as 


Br = 19) Bl + 19? p? a= 12> ° | (11) 
And when v> å 
OSmp<B ab=1,2 (12) 
If, for arbitrary 4 > 0, when v> œ, we have 
Bi 30 a=1,2 (13) 
then, by (11), for arbitrary 2 > 0, we have 
122 d EAN a=1,2 (14) 


as v— oo. Fix an arbitrary J, > 0, and let a? = Bis By (11), we have 


az 
p= tp! +e Ge B? 


Agv 


The left-hand side of the above expression is independent of v; by (13) it 


follows that the first term of the right-hand side converges to zero as v> œ. ' 


By (14) it follows that the second fraction on the right-hand side of the above 
formula must converge to some r4” that is finite and non-negative. Therefore, 
upon taking a limit as v> oo we obtain 


pt =a? 
Then we certainly have, the form (9). 


If (13) does not hold, then there exist some 4, > 0 and some a, (we had better 
say a, = 1 without loss of generality) and a subsequence v, — œ such that 


ti Bi a! 40 Osa <p (15) 
If, for every A> 0, we have ` 
7a > 一 0 a=1,2 


as v,-» 0c, then in the same way as used in the proof above, we can prove 


pear a O0<a' #0 
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Hence we obtain an expression of the form (9) for Bf. Otherwise, there exist 
some A, > 0, some a, (say, a, = 2 without loss of generality) and a subsequence 
v,(1}-+ co of v, such that 


{22 


iret Brgy? % 20 OS 0? < BF (16) 


Now for an arbitrary 4 > 0, (11) can be rewritten as 


te 
pa = Ay g! Mbit av 122 2 
A 111 Àv fiav y 
fae re 


We can also select a subsequence v,{2)— œ of v,(1) (the subsequence may 
depend on å) such that the two fractions in the above formula converge to 
non-negative numbers r3} and r4? as v= v,(2)— œ, respectively. Then, by (15) 
and (16), letting y = v {J> oo in the above formula, we obtain 


Since x’ and xz are not zero, it ae ie R, re is finite. Thus the form 


(9) follows again and the proof is terminated. QED 


By Lemma 1, it suffices for us to consider only Q processes (A) that have 
the form given by (1) and (4). 
We introduce the notation: 


j = 2[o0*p(2), X°] = La, X" — KAN] tae = [a° X°] Atv. (17) 
H, = (KPT = (h”) Ata (18) 
The above relation follows from X%(A)|0(Af 2c) and (7.4), By (2.11.40) 
(v — DEAA), XJ = Ae? — he? (19) 
We first consider a special case: .4, = 0, % < œ. That is, 
LF(A)] = &,[aA(A)] (20) 
[x51] < oo x= 1,2 (21) 


Theorem 2. Assume that F’(A) and F?(4) are linearly independent, and that F(A) 
and F(A) have the forms (20) and (21). Then for w(A) given by {1) to be a Q 
process, it is necessary ani sutien that it can be obtained as follows: Select 
non-negative row vectors « and «?, which are linearly independent and satisfy 

[a5 1] <1 «= 1,2 (22) 
Then, set 


WA) = PA) + [XAYVU- 7 
where 7 , = {[a, XIÐ]. 


a)‘ [ao(4)] (23) 
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The process wy{A) does not satisfy the system of forward equations. The vectors 
x! and x? (they satisfy (22)) are uniquely determined by this process. For the 
process f(A} to be honest it is necessary and sufficient that 


[at =4 a= 12 (24) 
Proof. (a) Let the Q process (A) be of the forms (20) and (21). Substituting (20) 
into (2), we obtain 

RH USO (25) 

Again substituting (20) into (3) and noting (2.10.9) and (19), we obtain 
R Ladb(v)] = #,l2b0)] + BH, — HJR Lob) ] (26) 

Multiplying the above formula from the right by (vI — Q), we obtain 

A fa] = 2[0]+ CINE EI 


Now that F(A) (a = 1,2} are linearly independent, by (20) it follows that x! 
and « are also linearly independent. Hence from the above formula, we obtain 


R =U RHL L HJ, (27) 
Select a subsequence 4 一 oo such that 
Ri, REO 
By (25), (27) and (22) we obtain 

RATA) <1] (28) 
R = a RA XN, l (29) 

Set [4] = Ala] = [0], and then (28) and (29) become 
[x1] <1 a=1,2 (30) 
=1-7,)#, F ,={{&X(A)} (31) 


But by (30), we obtain fa", Xå) + X7(A)] < I (a = 1,2). Therefore the inverse 
matrix (I — 7 ,)~' exists and is non-negative. From (31) it follows that 


R,=(1-F,) 'A& 
Substituting the above formula into (20), we obtain 
LF(A)} = A fap(A)] B, =(f- F i (32) 


Thus it remains to prove that 3! and %* are liniy independent. This can be 


seen from the above formula, because if &! and 4? are Mnearly dependent, then 


FI(2) and F (2) are also linearly dependent. 
(b) Let xl and g? be non-negative and linearly independent, and satisfy (22). 


Ve sai tie aks OE ak nate 


rype 


rR 


A 
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In (a) we have already proved that the inverse matrix #4, =(J — Z ,)~* exists 
and is non-negative. 
The F%A) (a= 1,2) defined by [F(A] =U —.7 ,)” [ap] are linearly in- 
dependent. In fact, let 
0 = [ce] FA] = LeU — 7)" fad()] 
Multiplying the above formula from the right by (AI — Q), we obtain 
0=[ U- 7) [中 
Since «° (a = 1,2) are independent, thus [c] — 7 
[e] = [0 
By (22) we obtain #[1] <[1], that is, (7 — W)[1]} > [0]. Since [J — 7 D{[1] = 
H [ll and (J — 7 ,) ! is non-negative, therefore [1] > (1 ~ 7 ,)” '|#,[1]. Hence 
(25) is satisfied, so that (2) holds. By a direct verification, we know (27) is satisfied. 
Therefore (26) holds and, consequently, (3) holds. 


(c) Since x! and a? are linearly independent, and since u; =X! (A)F | (A)+ 
X}A)F (A) satisfies 


2) } = [0]; hence 


(Au — uQ); = [X,(4) [a] 40 
it follows that the Q process w{2) does not satisfy the system of forward 
equations. 
For the equality to hold in (2), ie. in (25), it is necessary and sufficient 
that 7 — 7 ,)”'#,[1] = [1]. That is, 
(和 一 9 LU=. 


L1] 一 人 — 7 [C] 
Le. #[1] = [1], and (24) follows. 
Assume that both «* and & (a=1,2) satisfy (22) and, moreover, 
correspond to the same process, that is, 


U7) [ad] =U -— 7) ap) 
Multiplying the above formula from the right by (AJ — Q), we obtain 
G@—F,)"'[e]=U-7,) [a] 
Since X"(A)}0 (Af oo) and because of (22), we obtain [x] = [3] by letting 
At oo in the above formula. 
Thus the proof of the theorem is completed. QED 
We now consider the general case. 


Theorem 3. Let F%A) (a= 1,2) be linearly independent. For (A) given by (1) 


` and (4) to be a Q process it is necessary and sufficient that it can be obtained 


as follows: Select two non-negative row vectors 如 (a = 1,2) such that HL O(Ael, 
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and choose two non-negative matrices 


Oy 5" AM 0 
o=( a a) and a=( A ga) 


Moreover, they possess the following properties: 
(i) If r, is exit, then M” =0. 
(ii) M“>0 (a=1.2): or M%=0, M*>0 (b#a), 
(a = 1,2), xl and &? are linearly independent. 
(iii) At? < œ (a Fb). 
liv) $'? < les" <1, 5 


a" #0, or Mo =0 


>h? + M*/(r,—r,)(a #b). 

Set 

R =1-P+H +AU) 
M =U-SP4+H,4+ MU) NM 


where WT (Atco), which are determined by (17) and (18) for «& 
(a = 1,2); by (7.14) we obtain . 


(33) 


ocn =u 人 a) 


ry — r) + 0 
Finally y(4) is determined by (1), (4) and (33). 

For the process (A) to be honest it is necessary and sufficient that 5‘? = 
s*! = 1. For this process to satisfy the system of forward equations it is necessary 
and sufficient that [x] = [0]. For the process y(A) to have the forms (1), (20) 
and (21) it is necessary and sufficient that M'' = M?? =0, h < æ (a= 1, 2). 


AT xO (34) 


Proof. The proof is to be reached in several steps. 
(a) Suppose that the Q process w(A)} has the forms of (1) and ©) and is such 
that F%(A) (a = 1,2) are linearly independent. 
Substituting (4) into (2), we obtain 
FL <1] SER Ha + MM, (35) 
Substituting (4) into (3), owing to (2.10.9), (7.15), (19), and to the properties of 
XA) being an exit family, we obtain 
R Tapo] + -AEX O] 
= R[aply) ] + A CXu] + (RA, + AAU, =a Fa) LR Lap)] 
+A [XO]? (36) 
Multiplying the above formula from the right by (v7 — Q}, we have 
R [a] = R[x] + (RA, + MU, = SF JA [a] 
=(1-F,+ BiH, + MM )R LO) | (37) 


oo eng rE HONE T RE 


(err nn 


pos BREET e m n 


Wr weer ey 


Ve ETE a MRT POP ONE LACM RCN ME NE ee tere 
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Substituting it into (36), we obtain | 
Mis Sat RH, +H AU), (38) 
Set ò= 1 — s3, then d¢>0. In fact, 6420 by (35) If 6%=0, then 
si" = 1. By (35), 
2 
s$ = } (rth? + MU") = 0 (b #a) 
t=1 
Therefore, 
rïx = MF =0 (t = 1,2) 
Hence 
2 
= > (rah + MU") =0 
i= 
This is in contradiction with s% = 1. 
Dividing the ath of (35), (37) and (38) by 64, we obtain 
"a =, 0 §12 
FA < i= 2 (39) 
5 0 
R [ox] =U-P,4+ PA, + MUAR [0] (40} 
M =U- PHBH, + MUYA, (41) 
where 
5 一 0 (a = 1,2) (42) 
sr > Poh? + 3 Mau (a £b) (43) 
t=1 t= 
je ya 和 
pab — 4 Me = —-*- 44 
r 5 (44) 
Choose a subsequence 4 一 oo such that 
F> P RoR A >M (45) 
Then F = (5%), # = (F*)and # =(M") are non-negative, and by (39)-{44) we 
have! 
5“ = O(a = 1,2) sel sel (46) 
2 > A 
SP > rh + x Mu? (a #b) (47) 
1=1 = 
Alaj =(P + RH, 4+ MUR [a] (48) 
M=1-P+ PH ,+ MUYM (49) 
"Let O.oc =O. 
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By (47) we obtain 
M'? = M?!=0 . (50) 
If h? = oo, then 
r7? = 0 (a £h) (51) 


By Lemma 1, it follows that (i) of this theorem holds. Now set [&] = #[x]; 
then &°20 and 2’(A)jel (a= 1,2). Equations (50), (46) and (47) become 
(iv). Hence we obtain (iii). Equations (48) and (49) become 


a] =U SHR, + MUA [x] (52) 
M =I- f+,+ MUYM, (53) 

Next we prove 
Z #0 if M” =0 (54) 


For otherwise, we may as well assume M!!=0, g!'=0. Then by (52) 
and (53) we have 


11.1 12,2. sl2s,2t,1 22,2 
roa tra =F (ry a) tri a") 
la __ sl2a42 = 
Mf =5°°M*" (a = |, 2) 


Therefore, F'(A)=5'?F7(J). This is in contradiction with the linear 
independence of F'(A) and F(A). 
We proceed to prove that the inverse matrix 


F'=-F4+H,4+ MU) (55) 
exists and is non-negative. Hence by (52) and (53) we have 
R fa] = £5 fe] Re Gia A 
Therefore, : 7 
[FA] = 27 Rp) + A (Xap 
[F(A)]= Zi [ae] + Fy A (X(Ap] 


That is, (å) is determined by (1), (4) and (3). 
By (iv), (54) and (34), we obtain 


1 > 5% 一 (he = M” U) > gab 一 (h°? a MU) >0 (a z b) 
Hence I — F + H, +M U, has the form 
1+0 p? 
( -Pt 1 a) 


Consequently, its determinant is A > 0, and its inverse matrix %7 ' is 


ARP RE Nec 
AX 12 147 


(56) 


1+f''>1,,20 
1+P2>1,,>0 
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(b) We proceed to prove that for Fe( {a = 1,2) to be linearly independent - 
the necessary and sufficient condition is (ii). 
Obviously, the linear independence of F°(2) (a = 1,2) is equivalent to that of 


[EHA] + A [X(A) Let 


[c] { [a@g(4)] + .# EXA} =0 (57) 
Then multiplying the above expression from the right by (27 — Q), we obtain 
[c} [a] =0 [cA = [0] (58) 


Conversely, if (58) holds, then (57) certainly holds. In order that (58) is equivalent 
to [c] = [0], it is necessary and sufficient that (ii) holds. 
(c) Suppose that [0], Z and .A satisfy the condition of this theorem. 
Because (ti) implies (54), it has been pointed out in (a) that the inverse matrix 
(55) exists and is non-negative. Therefore, (4) can be determined by (1), (4) 
{where a" is replaced by 4°, a = 1, 2) and (33). Now we proceed to prove (2) and 


(3); that is, (35) and (36) where [«] is replaced by [£] hold. 


Since 
(2H + MM) = 2H, 4+ AH) = FOF, -U- AY 
=[1- 27 W- I] 
by (iv)and as %, ' > 0, it follows that (35) where [&] is replaced by [x] holds. 
Secondly, 
IT— Rt MU + RH + MU =L UZ, HH AUAA HAU) 
=PFUI-P +H, + MUJ= LF, 
(59) 
According, (37) and (38), where we and X , are replaced by # and #, respectively, 
hold, and it follows that (36) where [x] is replaced by [gj holds. 
(d) Now we proceed to prove that for (56) to have the form given by (21) it 
is necessary and sufficient that M'! = M?? =0, h” < œ (a = 1,2). 
Suppose that (56) has the form given by (20) and (21). By Theorem 2 that is, 


Py [EO] + XA) = — 7) Egl) (60) 
Multiplying the above formula from the right by (AJ — Q) we obtain 
l t [Q=U-F)" fal (61) 


Hence ¥7'.4# =0,.4 =0, so that M! = M22 =0. By (61) it follows that 
[#]=7,1-—7,)‘[x]. Since [x*,1]} <1, it follows that h” < oc (a = 1, 2). 
Conversely, if M © = M?? = 0and he” < œ (a = 1, 2) then [F(4)] in (56) obviously 
has the form given by (20) and (21). 
(e) The necessary and sufficient condition for the process to be honest or to 
satisfy the system of forward equations is obvious. Thus the proof is concluded. 
QED 
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5.11 THE CONDITION THAT ad(aje/ 
Suppose x > 0. By (7.3) it follows that ad(A)el is equivalent to 
> afl 一 — XHA] < x i>0 (1) 


In this section, we shall give the necessary and sufficient condition under 
which we decide whether af(A)e/ directly from Q. Obviously, it suffices to 
consider X> and 了 io of (1). We shall only consider E; o for the case i; <o 
is completely similar. 


Lemma 1. We have 


u, (A) = Uy (A > = yee a (2) 


jži Ha (Aus ja (A) 
for u,(A) and xz( in Theorem 5.9. 


Proof. Let the quantity determined by the right-hand side of (2) be v{4). We 
prove that v(A) is a decreasing solution of equation (5.1) and (5.14) holds, where 
v4) is replaced by u,(A). 

First since u,(2) and u (A) are increasing, 


1 1 i 
EN E Ea ee TR ( ee =) 
Dd ae ED aye) 


oy E e 
ud) ji u2j(4) u, j+1(4) uz(4) Bai) ualra, A) 


<- 7 <0 (3) 
u3(A) 
Therefore, the series (2) is convergent. 
Secondly, 
Z; 1 
vi (A) = ud (ay) YA (4) 


Siul, jail) uA) 
From (3) we see that 
l l 
uzl) uat) 


Hence v(A) is decreasing. By (2) and (4) it follows that (5.14), ener ¥(A) is 
replaced by u,{A), holds. By (4) we obtain 


vi (1 < 


haat 
Pa, iz, (0 


= Aua) ee em) 


4) = D,u3; 
i 名 OO A 


DY; 


EE re et RENT PA SR TE ASAP EE NES EAR er a A ESS I ROG RE AEE NT GS AER 
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that is, v(A) is a strictly decreasing positive solution of equation (5.1). 

If r2 is irregular, by Theorem 5.7, the decreasing solution of equation (5.1) 
satisfying (5.14) is unique. Hence (A) = u,(A). 

If r, is regular, according to Theorem 5.7 


人 三 天 [一 si] (K is a constant) 


- By (2), we have 0 = v(r,, A) = K[v(r,) — @s(r,)], so that 


Hence v(å) = Ku,(A). Therefore, v 


“(4 = Ku} (2). By (4) and the first expession 
of (6.8), we have 


v (ran A) = Kut (r,,A)= — . 
u(r a, D T A ualra A) 
So K = 1, and thus, v(A) = u,(A). The proof is completed. QED 
Lemma 2. Let r, be regular or exit, then 
L a ee (5) 
zn>rz F2 — Za Uz(r2, À) 
Proof. By (2) 
Hn(2) r2 一 2 
tin) < (一动 = 了 一 人 
MOS a a EE 
2 6 
U1 ,(4) > - poe È (41-2 j= tanta 2 i 
[ualra AY jen fates 
That is, 
O Ual) u inlA) 1 
Lufra, 1)] ry2—Zn UzA) 
From this, we obtain (5), and the proof is completed. QED 
Theorem 3. Let r be regular, then 
》 afl — Xi- X}{A)] < w (8) 
i20 
if and only if 
oi(r2 一 2 < (9) 


120 BILATERAL BIRTH DEATH PROCESSES 


or equivalently 


SANAR (10) 
izo 
where 
j i 
N;= 2: (2541 - 2,) >» m= ~ lina > (r2 一 kj (11) 
了 zi k=0 k=0 kzi+ 1 


Proof. Since 


1 — X1 — XA) = Au 4 ) È uj(4 )u; + Auy;( 


Si 


and when r, is regular we have J.» o H; < 00, from (5). Letting 


(Yu (Au; (0 
joi 


< taf) Yu, (Au; < Liu 人 © p= 


一 1x0=0 
Po 2; j>i 2 一 21 j>i 
Therefore 
1 — Xi- XA _ Au (A) 
lim EATA lim 一 一 》 uu; = ALX? Ap, 1] 
int« rr 2; i> +æ — 2; jsi 


If r, is regular, then 0 < A[X7(A), 1] < œ. From this it follows that (8) and (9) 
are equivalent. Secondly, (10) clearly implies (9). By (11) 


Ni < (rz 一 2 $, Hj 


j20 


Therefore, if r, is regular, then (9) also implies (10), and the proof is concluded. 


Theorem 4. Suppose that r, is exit, then (8) and (10) are equivalent, and (8) or 
(10) implies (9). 


Proof. By (6), (7) and (11), iff =>i20 


和 13 

tN ay aay at 7 

Uy fA L.) ; tai 人 te ats 14 

ae Fr T J [itr dP” 5 

Wy fA) r25; < Holr2 — Z)) a a (15) 

N; jdN  Uoaol AN; ti2o(A)Ho 
Fizo 

142) $ uay EA, E p ra = 29 (16) 
j=0 Py zi j=0 . 

uy ;(A) > u, (A); > ad | 2 w r- 一 2 (17) 

i=0 72 21 j=0 


A yee -he 
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Hence by (12), (15), (16) and (13) 
t— X} (A) — X}(A) 


N; 
f 乞 Hj raz 
A 4 t ? 4 P : i A 
a ua (A); + p ade, (4 uri 人 eee ee)  Yail4) ‘) F (r2 — z)h; 
U20(A)Ho i<o 72 一 2 Ni N; j>i taolM) 
< ae > uy (A); 十 ; Madar) 十 2 uzh) 
uzolÀ)Ho j<0 Py 72; Uo(A) 
By (5) 
a b= XA) XA 
Jim Ea Ae Xn t eini È te (Au; tat wala) — A) <æ (18) 
i> +a N; = Ho j<o U29(A) 
Similarly, by (12), (17) and (14) 
1 = X}(4) ~ XQ) 
N; 
,Hi(4) < 
> DY (Ayu: 22") 
N; >» Up i( ju; + ia ae uij (A) u; 
a Hi À A is j es: A 2A. At 
人 
ry z N; Ni ji Lulr2,A)] 
> MD) jn Hj a — 2) , Alta Aol AZ» lta = zH; 
[ura AT N; [u(r 2]? N; 
= AX}(A)X UA) 
and so 
os Dee X F(A) = - KIA) 
lim = EE 
i> + x N; 
> AXZA)>0 (19) 
Theorem 4 follows from (18) and (19), and the proof is terminated. QED 
Theorem 5. If r, is entrance or natural, then (8) holds if and only if 
F wxi < oo (20) 
i20 
Proof. The sufficiency is obvious. The necessity follows from 
lim [1—X/(A)J=1—X{r,,4)>0 QED 


i> +æ 


CHAPTER 6 


Birth—Death Processes 


6.1 INTRODUCTION 


Let E = {0,1,2,3,...}. The matrix Q has the form 


- (dq + bo) bo 0 0 
Q= ay —(a,+5,) by 0 stay (1) 
0 da td 


—{a,+b,) b, 


where ao > 0, by > 0,a; > 0,b; > O(i > 0). We call the Q process of the form (1) 
a birth—-death process. In this chapter, Q will always have the form (1), and the 
Q process will always be understood to refer to a birth--death process. 

We point out that, for a matrix Q of the form (1), the relation - 


F 2 dij (2) 
jti 

is satisfied when ay = 0, and is not satisfied for i= 0 when a, > 0. That is, Q is 
conservative when a,=0 and is single non-conservative when a, > 0. The 
dimension of the solution space .4, is m* <1 when a, 20. Therefore 
construction of the birth-death process in the case ag = 0 or in the case ay > 0 
and m* =0 is solved by Theorem 3.2.1 and Theorem 3.3.3. It is slightly more 
complex if ag > 0 and m* = 1, because in this case it is possible that there exist 
Q processes that satisfy the system of backward or forward equations, and also 
Q processes that satisfy neither the system of forward equations nor that of 
backward equations. Birth -death processes are regarded as diffusions in Feller 
(1957b, 1971) and all possible birth--death processes that satisfy simultaneously 
the system of backward and forward equations are found in the case ay > 0. 
The author (Xiang-qun Yang, 1965a) has constructed all possible birth-death 
processes. 

This chapter is concerned with the construction theory of birth-death 
processes, which is very similar to the construction theory of bilateral birth- 
death processes dealt with in the previous chapter. For this reason we shall 
make simple statements or supply brief and simple verifications on some 
occasions. 
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6.2 CLASSIFICATION OF BOUNDARY POINT AND 
SECOND-ORDER DIFFERENCE OPERATOR 


For the matrix Q of (1.1), we call 


Zo = l/aņp (fa > 0) Zo = 0 (ifa = 0) 
Zi = Zo + l/h 
(1) 
Z, = Zo + x ane Rei Se Racal ey (n= 2,3,...) 
po bobba: by- 
the natural scale; we call 
z= lim z (2) 
n= +0 
the boundary point; and we call 
pol mot ea a> (3) 


Qi dy 1G, 
the canonical measure. 
The boundary point z may be classified by means of the natural scale and 

the canonical measure. We say that the boundary point z is 

(i) regular if z < œ, JH; < ©; 

(ii) exit if it is not regular and Yi(2 — zi; < x; 
(ili) entrance if it is not regular and yz. < 2; 
(iv} natural for all other cases. 


We also introduce the characteristic numbers as follows: 


Ma = - = (Z; — Zo)Ho 


il aja; rina . 
m= b, EL re bi- b,- = 2541 -a5 Hk i>0 (4) 
£o = Zo 2 Hx 
k=0 
1 bibs bing 2 
ei 一 一 十 X — = (2, — Zi ) i>0 5 
a; eae Gis Girne l ot P 
= pie È mt Ye E-z (6) 
j= j= J=i+1l 
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X. 1: 
R= 3 a > (2 — 2); 
j=0 j=0 
a) ge 
S=} e= 2 zH (7) 
J=0 j=90 


Theorem 1. The boundary point z is 

(i) regular if and only if R < %,S < w; 
(ii) exit if and only if R < œ, S = 0%; 
(iii) entrance if and only if R= %,S < %; 
(iv) natural if and only if R = œ, S = œ. 


Proof. It is similar to Theorem 5.3.1. 


We can introduce the second-order difference operator, by (5.4.1), but in the 
case i = 0. We shall make appropriate modifications. 
Suppose that u is a column vector on E. We define u* as follows: 


+ Ke, 7; 


ut = (i > 0) (8) 


: 7 
Zi+1 7 25 


For convenience, we will adopt the following convention from now on: 
ut, = doto u. =0 (9) 
Let u be a column vector on {— 1}UE. We define D,u as follows: 
Da er {i >0) | (10) 
Hi 


Theorem 2. If u is a column vector on E, then 


Qu=D,u* (11) 
That is, 
d;a — (a; + bu; + bitis = Due i20 (12) 


Proof. It is similar to Theorem 5.4.1, but we must notice convention (9). 


Theorem 3. Theorem 5.4.2, together with its corollary, and Lemma 5.4.3 are 
also true, and even their notation need not be changed, if only we understand 
E as referring to the set of non-negative integers and Q is the matrix of (1.1). 


Lemma 4. The solutions of equations 


— (ao + boto + bot, = — fo 
ait; — (a; + biju; + biu; = fi 
Un = fn 


O<i<n (13) 
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are 


Za Zi aot2i 一 2z0) 十 | 
H; 一 一 o c -i fa TOVA Zo) + 


do{zn — Zo) + 1 a,{z, en ra 


— È Las 


se — z + ] sti: 
R —Z 证 E o) JSk; 


Z; 一 n-1 
ga: Zo) + +! 


-一 一 2， 4 
dolzn — Zo) + 1 ji a R ne 
Proof. By (5.4.12) 
n Zi Zi Zo Za i i " 
u; += + j 
Za — Zo A a a Zodat 
Z; 2 . 
| Zn £9 j=i 
In particular, 
Zn Zi Zi — Zo Zi 
Uy 一 一 -一 to 十 一 一 一 六 十 一 一 一 一 16 
Zn — Zo : Za — Zo Za = eee "9 
So by (13) 
b | 
pet ae ee, ais 


do+ bo ao(z, SPRER) ao(z1 — zo) + | 


By (16) and (17) we derive 


2n Žo 


1 
oe Ag(Z_— Zo) + | 1 Ay (Zn ee I oy alz, — “Ss + rer > (en = Zihi 


Substituting the above expression into (15) we obtain (14), and the proof is 
completed. QED 


Lemma 5. The solution of the equation 
Duu* =f (18) 
namely the system of equations 


— (ao + bojuo + bot: = fo 


au; — (a; + biju; + bu. = fi (i> 0) Sa 
is 
p 
u; = [ao(zi— Zo) + 1]uo + ¥ (z; - ZS ju; (20) 
j=0 
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Proof. By (19) we have 
Ug = dotto + foko (21) 
us — us, = fib i>0 

Therefore 


ur =u t+ ¥ (u; 


i i 
— Uj 1) = douo + foko + o3 Jili = aouo + 2 Jiki 
j=: j= 
E= i—i og 
j=0 了 = 人 


F-1 
= lto + iS 
j=0 


(cot +> fan ep = 85) 
k=0 


i— l j 
= Uo + dolz; — Zoio + 7 (2541-2) È, Sit 
j=0 k=0 


p= 


= [ao{2z; — Zo} + Juo + y (25-2) fj; QED 
j . 


=0 
Corollary 
The solution of the equation 
Qu=0 | (22) 


ui = [aolzi; ~ Zo) + 1Juo i>0 (23) 


6.3 SOLUTION OF THE EQUATION iu — D,u* =0 


Theorem 1. For every 4 > 0, the solution u(A) of the equation 
4u—D,u* =0 (1) 
with condition uo = 1 exists and is unique, and has the following properties: 


(i) Both u(å) and u*(A) are strictly increasing; 


{ii} u(z, À) = lim; „ , w(4) < œ if and only if z is exit or regular; 


(ii) u(A)wel, Le. m A) = lim,., ..u; (A) < œ ifand only if z is regular or entrance. 
Proof. By (2.20) it follows that u,(A} necessarily satisfies — 
u{A) = 1 + ao{z;— Zo) + = (z; — zu (å); (2) 
= 
From this we can determine (4), u2(A),..., and hence u(A) exists and is unique. 
By (2) it follows that xf(A is strictly increasing. 
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Secondly, 
u (A) = ao n 2 Daut (Wry= aoti Y uju; (3) 
j=0 j 


J=0 
So u*(A) is strictly increasing. 
The proof of (ii) and (iii) is similar to Lemma 5.4.5, and the proof is completed. 


Theorem 2. Suppose that u(A) is the solution of (1) in Theorem 1; set 
à AO a 
vilà) = ula) X L. (4) 
2 u (Aju; 4 fA) 
Then e(A) is strictly decreasing while v*(J) is strictly increasing, and 


0 ifi>0 
Av. A 一 二 2 = 
àvi) Duet (2) T Aa (5) 
ut (A)e(d) — vt Auf) = 1 i>0 (6) 
v*(z, A) = lim vý (4) = 一 an me (7) 
ime u(z, A} 


. (The right-hand side is zero when u(z, 7) = a.) 


Proof. As we did in Lemma 5.11.1, we can obtain the convergence of the series 
in (4) in a way similar to (5.11.3). Similarly to (5.11.4) we have 


n Zia, —2Z; 1 
De a 
py re o 
ee 1 
PC<--: 0 (9) 


uli) uj(d) 
Hence v(A) is strictly decreasing. From (8) we obtain (6). And again by (8) 


] x ae 1 
一 一 一 所 tA < + 2 pf cee Rida: N a 
aay oy at 
s/l 1 1 
EG a uA) 
ted) ugi 


From this follows (7). By (8) and (2.10) we obtain 


Dye (A) = Daut (A) LE! = ho) 
jiu (A (A) 


when i> 0, and we have proved the first line of 5). 
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To prove the second line of (5) note that by definition (4) of (4) we have 


Mian =e ab (11) 
tig(4) 
As uf{A) is the solution of (1), so 
hott, (A) = (A + dg + Dolo (4) = 4+ ag + bo (12) 
Substituting the above expression into (11) we get the second line of (5), and 
the proof is terminated. l QED 


6.4 CONSTRUCTION OF THE MINIMAL SOLUTION 
For the solution u(A) of (3.1) and v{4) determined by (3.4), 


ry 人 itj >i ii 
v (Ayu (Ae; fj <i 
Similarly to (5.6.1)- (5.6.5) we have 
Hibil) = Hj lA) (2) 


If f is a column vector and g is a row vector, then 


[OAS = LOWS = 2A) ay Yu uA) fpu; + uf) J AS 0) 
j j= 


įj=i+1l 


[9p(4)] =}; pA = v,( “> gud) + udp; > wa (4) 
i=jti 
If g = fu then 

gbl) = (PA) Ae (5) 

Theorem 1. The following holds’: 

u;(A} : 

A= 1 — d. ae eae 6 
A > $A) | dot (A) uz, i) ( ) 


Proof. By (3) and recalling convention (2.9), 
A > (A) = 0,(A) > [uF (分 一 
j j=0 


= vAu? (A) — uy (A) — aovilA) + u (Ae (z, 2) 
On account of (3.6) and (3.7) the above expression is precisely (6). QED 


up AJ+ua) È Poff A 


j=i+1 


! Suppose 0/00 = 0. 
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Theorem 2. If fem,gel then (A) fem, gd(A)el and 
ALOT — OL6(A SI = f i>0 (7) 
~ AL9b(A)] — Lgl) =g A>O (8) 


Proof. We only prove (7). In the case i > 0 the proof is similar to Theorem 5.6.2. 
But in the case i = 0 we must take care. By (3) we obtain 


[Gf] = 07 (2) 3 wDf turd) > 


vA) Sj; (9) 
J=0 j= +1 
[PAS Ig = vo (Afo + ug (A) $ vA) fn (10) 
j=l 
Recall the convention (2.9), 


[OAS] =, = ao LOA To = dovoli) So + aouolå p Bi(A)S jy 


Ao tut È DS (11) 
By (10), (11) and (3.5) 


DALAL = Dyes Oo + Dug O) È wim 


= [Av9(A) — 1] fo + Auo(A) ye MASH; 
=[(AF]o— fo QED 


Lemma 3. Suppose that fem, and z is regular or exit. Then 


LASJE = lim [Af] =0 (12) 


i> w 


Proof. Because if z is regular or exit, then z < oo and u(z,4)< œ. By the 
definition (3.4) of v(A) we have lim,_,.v,(4)= v(z,2)=0. By (6) we obtain 
[Ap(A)1](z) = 0. From this follows (12). QED 


Theorem 4. (A) is the minimal Q process. For @(A4) to be honest it is necessary 
and sufficient that ao = 0 and z is entrance or natural. 

If z is natural, then (A) is the unique Q process satisfying the system of either 
forward or backward equations. 


If z is entrance, then ¢(A) is the unique Q process satisfying the system of 
backward equations. 
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If z is exit, then ġ(2) is the unique Q process satisfying the system of forward 
equations. 


Proof. From Theorem 1 the norm condition of $(2) follows. By Theorem 2 we 
obtain the B condition and F condition for (å). To prove the resolvent equation 
for (å) let fem and F(A) = (å) f. Then F(A) — F(v) + (4 — v)b(A)F (Wem is the 
solution of equation (3.1). Consequently, 


F(A) FO + (4 — VO) Fv) = cud) (13) 


where c is a constant. If z is regular or exit, by Lemma 3 we get cu(z, 4} = 0 and 
¢ =Qasi— æ in the above expression. If z is entrance or natural, then because 
the left-hand side of (13) is bounded and u(/) is unbounded, we get ¢ = 0. Hence 
we always have c=0. Take f;=6,; and obtain the resolvent equation of (4). 
Thus, (4) is the Q process satisfying the system of backward and forward 
equations. 

Suppose that (4) is an arbitrary Q process. By the backward inequality 
(2.8.10) and Theorem 2.7.3 it follows that for fixed j, u; = ,,(4) — $,,(2) satisfy 
the following equation: 


Au; 一 he = 14 
z È, dati fe ifi>0 (14) 


Hence u; — c v;(2) is a solution of equation (3.1), so that u; — c4 v:(å) = cau;(å); 
that is, 


W lA) = pilh) + civil) + cui(h) (15) 


where c, and c, are constants which are independent of i, and c, 2 0. 

If z is exit or regular, by Lemma 3 and v{z, 4) = 0, which is proved in Lemma 3, 
we obtain c,u(z,4} 20 as i œ in (15) and, hence, c, 20. If z is entrance or 
natural, as the left-hand side of (15) is bounded, and only xj is unbounded in 
the right-hand side of (15) it follows that c, = 0. Thus, we always have c, > 0, 
that is (A) => @(A). We have proved the minimality of P(A). 


If y(A) satisfies the system of backward equations, then u, = ¥;,(7) — (å) is . 


a solution of equation (3.1), so that 
WA) = plà) + cu,(A) (16) 


where the constant ¢ >0 is independent of i. If z is entrance or natural, we can 
prove c = 0 in the same way as was used in the proof of the minimality of (A); 
hence $(/) is the unique Q process satisfying the system of backward equations. 

If wy (2) satisfies the system of forward equations, then v; = ¥;,(A) — $;,{4) is a 
solution of the equation 


Av—»Q=0 (17) 
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whereas MA is the unique linearly independent solution of (17), so that 
pilh) = pilh) + cu (Au; (18) 
where c is a constant independent of j. If z is exit or natural, then by the norm 


condition of &(4) and $(A) we obtain c = 0. Hence (A) is the unique Q process 
satisfying the system of forward equations, and the proof is concluded. 


Remark 
If ao =0 then c} = 0 in (14). Therefore by the proof of this theorem it can be 
seen that any Q process (4) has the following form: 


Wi) = pl) + ao vA} (A) + ay F3(A) (19) 


where F(A) 20. Here w{A) satisfies the system of backward equations if and 
only if F'(A) =0; and (A) satisfies the system of forward equations if and only 
if y(i) has the form (18). 


6.5 SEVERAL LEMMAS 


From now on, we will simply write 


A) 
X1(A) = agv(A xray = av 
ovi(4) 7 (A) uz, 2) (1) 
eee seme a Fo) el (2) 
"  Ag(Z—2Zo) +1 "  Ag{z—Z9) + 1 
Obviously, X + X? = 1, and (4.6) becomes 
4 的 (1 = 1 — X(t) — X7(A) (3) 
Lemma l. X“(A)(a = 1, 2) are two exit families and 
、 0 ifi>0 
XI1(D10 ax | At 
if 一 TA (41%) (4) 
X (ALO AX (4) +0 (AT x) (5) 
AQX = X7— X2) a=1,2 (6) 


Proof. It suffices to prove (6). When a, = 0, (6) is obvious for a= 1. For a=2 
(6) follows from (3). In what follows, we suppose a, > 0. 
If z = œ, then X? = X*(4)=0, X! = 1, by (3) we also get (6). 


X 
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Ifz< x, then 


Ax PAZ — Z;) 
j 


wD 
j y (Zk+ 1 — 24) 


k=j 


= 14) ¥ uae 
j=0 


tu È, Mn D Gres ~ 20) 


j=i+i k=j 
i k 
k=0 ) 2. 


+ S Gaiz) í ju iu) 


= vi(2) > (zk+ 1 — zu (4) — ui (2)] 


=0 


十 y (Zk+ 一 z,)Lu; (A) ee oO) 


k=i+1 


tul) È Geer 20080) — 07 I 


k=i+1 


= TI y [uy (A) — u,(Ay] + ur (A)(z — Zis) 
k=0 
vt (ae— z) 


suo $ [ey (4) — v,(4)] — oF (A(z -zs 


k=i+1 
= (WD) ~ ug(A) + uf (AMZ — zi) — aouo l(A2 — zo) ] 
+ u(A)Lv(z, 4) — v4) — v8 (Ae — 2D] 
= [u7 (AeA) — wider (Az — z) — Daol — Zo) + Ue) 


= (z — z;) — [ao(z — 29) + 1] 0A) | (7) 
Multiplying both sides by ao/[ao(z — Zo) + 1] we obtain (6) for a= 1. From this 
and (3), (6) follows for a = 2 and this completes the proof. QED 


Lemma 2. (i) Let X° and X be the maximal passive solution and the maximal 
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exit solution in Definition 2.11.3, respectively. Then when z is regular or exit, 
X? = 0, X = X?; when z is entrance or natural, X° = X? X =0. 

(ii) The standard image of X '(A) is X'. If z is regular or exit, then the standard 
image of X?(A) is X?. 


Proof. By the corollary to Lemma 2.5 it follows that the unique linearly 
independent solution of equation (2.11.18) is X?. But both X° and X are 


solutions of (2.11.18); hence X° = ¢X*, X =éX? (c and @ are constants). 
Suppose z is exit or regular, then X? 40. By (6) 


p(X = c[K? — X7{4)] = X? — eX 2A) 
A@(A)\X = LX? — X?{4)] = X =X?) (8) 


Comparing (2.11.17) with (2.11.19), we get c=0, and č = 1. 

Suppose z is entrance or natural. If aoz = oc, then X*=0 and hence 
X° = X?, X =0. If agz < œ% then X? 40. And because X2(4}=0 the solution 
space .H+ (1) is a null space, so the standard image of X(A)=0 is X =0 while 
{6} becomes 


Ab(a)X? = X? 


By the maximality of X° in Lemma 2.11.2 we obtain X? < X? =cX2?, so that 
c > l. But obviously, X? = cX? < 1, and we obtain c < 1 by setting r — oc. Hence 
=1,X° = x2. 

y (6) for the standard image X? of X?(2) we have X? < X?. As is the case 
with Lemma 5.7.5, u = X? — X? is the solution of equation (2.11.18) satisfying 
(5.7.21). By the maximality of X° we obtain X? — X? < X°. When z is regular 
or exit X° =0, X? = X?. That is, the standard image of X(A) is X?; hence the 
standard image of X'(A) is X1. 

If z is entrance or natural, from (2.11.13) follows that the standard image of 
X'(A) is X'=1—X°— X = X' and the proof is concluded. QED 


Lemma 3. Set 


TE [x H if zis regular 
C  ([ao(z)— 29) + lJa; 


2% 
(a) = ees ee 
ao (z, A) 


if zis entrance (9) 
if zis regular 

if z is entrance 

Then #(A)e Zt (A > 0) is an entrance family, and 


ARPA) = Ñ — HA) (10) 


Proof. We need only prove (10). By (6) and (4.5) we derive (10) when z is regular. 
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If z is entrance, then u(z,A4) = w, u7(z, 4) < æ. By (3.7) 
v*(z,4)=0 (11) 
Furthermore 
1 
v(z, A) = ——— (12) 
EA u*(z, A) 


In fact, notice that u(A) is increasing and v(A) is decreasing, so 


X Àv (A) oy 


k=i+1 


0 < — ufA)o (4) = uA lot (z, A) — vf (4] = wl) 


< voli) > A (A = Uo{A)[u* (z, 4) — už (4) ] 0 (i— œ) 


k=i+1 
From this and (3.6) follows (12). 
Secondly, by noting (11) and (12), 


A 3 的 kx(4j(2 — Zo) 


i k-1 
= v;(A) > Au A) oe > (zj+1 一 2 站 十 u,{A) 5 Av, (A) iy = (Zj41—2,) 
k=0 j=0 


k=i+1 


i—l x 
=0(A) È (244-2) $ duâ 


j=0 k=i+1 


+ wal È e 1—2 K pi) Aol (Ayu, + S (zj+1 — 2;) 3 itn) 


i=j+1 k=i+1 


DF (zj 1 — 2) ur (2) ~ ut (NW 


+ ui al. > (Zj41 — z){v*(z, A) E vi (A)] 


+ > ett 


= wae (A)(Z; ~ zo) — [u;(2) — uo (A}]} 
+ u(A){ = vi (Ar ~ Zo) ~ Eole, A) — 944,10) ]} 
= vA) [uj (Azi — zo) — ud) + 1] 


z,)[v*(z,4) v; a) 


二 
十 wd( — v; (A}(2; — Zo) ET aj n) 
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+ y +45 (A 
一 [Ta (esf 人 一 aif4jp (4) ](2; — Zo) + vi(2) — 2 ) 
u (z, A) 
u,(A) 
= (Zi — Zo) — v,(A) — ——--- 
( o) — 0,(A) u*(z,2) 
Hence by (4.5) and (6) follows (10), and the proof is terminated. QED 


Lemma 4. For a family 4(A)(4 > 0) to be an entrance family it is necessary and 
sufficient that it has the following Riesz expression: 


n{4) = ap(A) + dn(A) (13) 


where row vector « = 0 is such that af(A)el, the constant d > 0, and d=0 if z 
is entrance or natural. Also 


apo) _ |X (Alp 
— ae *(2,2) 


if z is regular 
eee (14) 
if z is entrance 


Proof. Since .£7 contains a non-null entrance family #(A) if and only if z is 
regular or entrance, this lemma is a particular case of Lemma 2.11.3. QED 


Lemma 5. If z is regular, then 


Us = ALX (Au, X11 U" Af co (15) 
where 
oo ar en U?= +% (16) 
Ag{zZ — Zo) + ł 


Proof. Now (2.11.40) becomes 
ALX (Ap XJ — yLX u, X°] = (4 — EX u, XUV) 
= (4 — v)[X v)u, X(A)] 


From this it follows that US is monotone. 
Next, by (6) and (4.9} we have 


A,v>Q (17) 


CAGOX = av) E wD + Aur) È 。 
j=0 


j=i+1 


v(4)X u; 


= [X°]; [XW]; 
Noticing (3.7) and letting i œ in the above expression we obtain 


- U3 = 1X12) -X WTO 
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From (2) we have 


a 
Oe ee 
pe Ag(Z — Zo) +1 

Therefore to prove this lemma, we need only prove 


lim [X A] (2) = op lim (X *(A}]*(z) =0 (18) 
A> a: A>: 
This is similar to the proof of (5.7.18) and (5.7.19). Thus we complete the proof of 
this lemma. QED 


6.6 CONSTRUCTION OF THE Q PROCESSES SATISFYING 
THE BACKWARD EQUATIONS 


By Theorem 4.4 it follows that the Q process satisfying the system of backward 
equations is unique if z is entrance or natural. Hence we will suppose that z is 
exit or regular. In that case z < cc, u(z, 4) < 00. 

By the remark of Theorem 4.4 it follows that the Q process satisfies the system 
of backward equations if and only if y(A) has the form 


Uda) = Bu + X 20A)F A) | (1) 


where the row vector F(A)>0. Hence the construction problem of the Q 
processes satisfying the system of backward equations has already been 
contained in Theorem 3.2.1. Certainly, in the case of birth-death processes we 
will obtain a more specific and simpler form. 

In this case, in Theorem 3.2.1, H = {0}, i(2) becomes dX 7*(A)u, while the 
constant d > 0, and d =0 if z is exit, where 


Viedy'= _ ado S: 
ag(Z bap Zo) + 1 
Note that X? =0, X = X? follows from Lemma 5.2. Therefore Theorem 3.2.1 
takes the following form. 


Theorem l. Let z be regular or exit. For W(A) to be a Q process satisfying the 
system of backward equations it is necessary and sufficient that either Y{A) = (å) 
or (A) can be obtained as follows: Select a row vector a > 0 such that aP(Ajel, 
take a constant d > 0, and d= 0 if z is exit. Moreover 


nià) = ab(A) + dX (Ayu #0 | (2) 


i 


or 


Te oot ett ee NR 


-一 人 rr vc REET TT a e 


-ni TL NE ea TET TET AA ~ 
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Take a constant c so that 


is satisfied, where X"{a = 1,2) are determined by (5.2). Finally set 


(A) = $A) + X20 dete Pr (A+ AX FAs 
Yi) = Os) + XO) TT I yA] AX A Ky ©) 


For the process y(N) to be honest it is necessary and sufficient that a, = 0, 
and c = 0. For the process (A) to satisfy the system of forward equations it is 
necessary and sufficient that g =Q. 


6.7 CONSTRUCTION OF THE Q PROCESSES SATISFYING 
THE FORWARD EQUATIONS 


Because of ‘Theorem 4.4, we need only consider the case that z is regular or 
entrance. Since the Q process (A) satisfies the system of forward equations if 
and only if the y (2) has the form (4.18), that is 


Wilh) = pilh) + FAH (A) (1) 


where (A) is determined by (5.14), the problem of construction of the Q processes 
satisfying the system of forward equations is solved in Theorem 3.4.1. 
First let us suppose that z is regular. In this case, #(A) = X?(2)u. According 


to the notation in Theorem 3.4.1, either (4) = O or E(A) = X (å). If E(2) = 0, then 
W, =A), X] = U2 tU2 = + 


This is in contradiction with (3.4.3). Therefore it necessarily follows that 
(A) = X7(d), and hence 6 > 0. According to the same consideration, the k in 
(3.4.3) must be 5~'. By (3.4.4) we obtain f° < ô. In addition, 


ao 


Paten ne 
ao(z — Zo) + 1 


X°=0 


‘Therefore if we replace f° by the constant f, then Theorem 3.4.1 takes the 


following form. 


Theorem 1. Let z regular. For (A) to be a Q process satisfying the system of 
forward equations it is necessary and sufficient that either (A) = P(A) or H(A) 
is obtained as follows: Choose a non-negative constant f and a positive constant 
6, $ < ô, and a constant c that satisfies 


CN 2) 


Golz <= Zo) + 1 
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Set 


i 27] ži; 
WA) = GA) + [BX : eects, (3) 
c+ ALX {Au BX" + 6X *] 

For the process (4) to be honest it is necessary and sufficient that 
ao > 0, B = 6,c = 0 or ay = 0,c = 0. For the process (A) to satisfy the system of 
backward equations it is necessary and sufficient and ag = 0 or ay > 0, 8 = 0. 

When z is entrance, the construction of the Q processes satisfying the system 
of forward equations, of course, can be deduced from Theorem 3.4.1. We shall, 
however, proceed as follows. 

We assume that z is entrance or natural, whence u(z, 4) = œ. If ao = 0, then 
the minimal solution is honest, and the Q process is unique. Consequently we 
further assume that ao > 0. Thus, (5.3) becomes 


Ap(ayl = 1 — X? (A) 
By (4.19), an arbitrary Q process has the form 
WA) = PA) + x} (A)F (A) (4) 


Hence, in this case, the construction of the Q process is a special case of 
Theorem 3.3.3. 
On account of the decreasing property of v(A) it follows that 


sup X}(A) = aguo(a) < 1 l (5) 


Therefore, if z is natural, then is null entrance, by Theorem 3.3.3 the Q process 
is unique. 

If z is entrance, by Theorem 3.3.3 it follows that every non-minimal Q process 
is obtained by Theorem 3.3.1. According to the notation in Theorem 3.3.1, in 
this case 


F u{A)p 
A)= 
2 u*(z, 4) 
and constant d > 0, whereas 
d 
Y, = A[a(A), 1] =— AufA)u; 
1 一 4[ 1] Ga? u{A)u 7 
d A day 
= ~ „A)— ut (A =d- — `- 
rea” Gamus] u*{(z,A) 


Therefore Y <d < œ. By (3.3.5), if a #0 then it must follow that [a, 1] = œ. By 
(5) and Lemma 3.3.2 there does not exit such a row vector g. Therefore it is 


certain that x = 0. Hence d > 0. Thus the Q process of Theorem 3.3.2 satisfies 


Tp ST NT 


nA ent cow ln eee on nid TO ara Fm 
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the system of forward equations. If we write ¢ for (c — ¢°/d) in Theorem 3.3.1, 
c+ dan(s), 1 — X°] = dé + ALAA), 1) 


If we still write also c for ¢, then we obtain the form of Theorem 3.3.3 as follows. 


Theorem 2. If z is natural, ao > 0, then the Q process is unique. Assume that z 
is entrance. Then the Q process is unique if a, =Q; if ag > 0 every Q process 


w(A) satisfies the system of forward equations and, moreover, either y(i) = (A) 
or 


| XDA) 
P = 6,44) + -—__ 3 
Wild) = duh Eg ALR), 1] 


E constant c > 0, n(A) = u(å)u/u * (z, 2). The process wy {A) is honest if and only 
ifc=0. 


(6) 


6.8 CONSTRUCTION OF THE Q PROCESSES SATISFYING 
NEITHER BACKWARD NOR FORWARD EQUATIONS 


When z is entrance or natural it has already been investigated in the preceding 
section. We assume that z is regular or exit in this section. Since when a, = 0 
any Q process satisfies the system of backward equations, we assume further 
that ao > 0. 


By (4.19), each Q process (A) has the form 
iA) = pilh) + X {AF} (A) + XPF F(A) (1) 


where F%(A} > 0. By Theorem 2.12.1 we have A[F'(A), 1] < 1. 

We shall determine F(A) (a = 1,2) such that y(4) determined by (1) satisfies 
the norm condition, the resolvent equation are the Q condition. 

If the norm condition holds for w(A), by (53), that is 


X*(A)ALF} (A), 1] + XP (ALF?) 1] < X?) + X?) 
holds. Letting i>co and noting that X!(z,å)=0, X?(z,å}=1 we obtain 
AL F?(A), 1] < 1. Therefore, the norm condition is equivalent to 
F%(4) > 0 AL F*(A}, 1] <1 a=1,2 (2) 


As in bilateral birth-death processes, the resolvent equation for WA) is also 
equivalent to 


F°(A)A(A, v) = F%(v) + (v — 2) $ LFA), X°(v) FQ) (a=1,2,Av>0) (3) 
b=1 
(a) Now suppose that F’(v),F?(v) are linearly dependent for some v>0. 
Therefore provided we make some proper modifications the discussion in 
section 5.9 is still valid. We shall state them in the form of the following lemma. 
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Lemma l. Suppose that z is regular or exit, and F°(4) (a = 1.2) are linearly 
dependent for some (hence for all) 4 > 0. 


For w(4) of (1) to satisfy the norm condition and the resolvent equation it is 


necessary and sufficient that either ¥(Z) = ġ(4) or W(A) is obtained. as follows: 
Choose constants d, > 0 (a= 1,2), d; +d, >0, p20 (p=0 if z is exit). Select 
the row vector x > 0 so that «@(A)el and 


y{A) = ad{A) + pX7(A)u #0 (4) 
If d, >d, it is also required that 
[x, X?] < æ% p=0 (5) 


Choose a constant c satisfying 
c20 ifd, =d, . 
ifd, >d, (6) 


c È (d; —d,)W. 
c>(d,-—d,)W, ifd <d; 
where 
Pao 
W, =[a, X1] + 一 " 
= | dolz — Zg) + 1 
=[a,X7] + pU?. (7) 


Finally, set 
= [di Xi (A) +d. X7(A) Ind) 
Wi A) = bi(4) + e+ nO) a YX dX 


Remark 
Upon comparison with Theorem 5.9.1, this lemma does not require that 
W, = lim A[n(A), X'] < oo 
A> æ 


since by Lemma 2.11.4 it follows that W, is finite. 
To prove that w(A) of Lemma 1 is a Q process, we must also verify the Q 
condition, that is 


lim AX*(A)AF{(A) = 0 a=1,2 (9) 


A> gD 


By (8) and (2.11.26), we have 


lim AFA) = se (10) 


由 加 C c+dil W, +d, W, 
Therefore, by (5.4) and (5.5) it follows that (9) holds except for the case a=}, 
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i=. For the case a= 1 and i = 0, (9) becomes 
aod; 2 
c+d, W, +d, W, 


Now assume d, >d, > 0. By (5) and (6) we obtain W, = [x, X?] < æ, p=0. 
By (4) we derive « #0. The above remark has already pointed out that W, < æ. 
Therefore, (11) cannot possibly hold. Therefore, it must be that d, 2d, 20. 
Thus (6) becomes 


c20 ifd, =d, 


Pao 
-> {d — d a e ee 
Ead a(t ] tte) 


(11) 


ifd, <d, (12) 


For (11) to hold it is necessary and sufficient that either dix =0 or W, = 
Since [a, X+] < W, < œ this necessary and sufficient condition becomes 


d,«=0, or p>0, or p=Oand [a, |] = x (13) 


We have thus obtained the following theorem. 


Theorem 2. Let z be regular or exit, ag > 0. Let F%(4} (a= 1,2) be linearly 
dependent. For Y(å) given by (1) to be a Q process it is necessary and sufficient 
that either (4) = (å) or w(A) is obtained as follows: Take a row vector « > 0 
so that a@(A)e!l and select constants d, >d, 20, da >0, p20 (with p=0 if z 
is exit} and c satisfying (4), (12) and (13). Set 


[d Xx; (A A) + dy Xi (AVE eM Pad A) + pX; (A) Hj] 


Vu BD S (fa Xt XA + PAX) ) 


(14) 


This process is honest if and only if d, =d,, c= 0. A necessary and sufficient 
condition for this process to satisfy neither forward nor backward equations is 
d, >0, a #0. 

The proof of the last conclusion is as follows: Multiplying both sides of (1) 
by (Al — Q) from the left-hand side, we find that the B condition is equivalent to 


ifi>0 


0 
oA- OKADA, Fi(2) ifi=0 
ofj ~ 


Multiplying both sides of {1) by (Af — Q) from the right-hand side it follows 
that the F condition is equivalent to 


O = [X}(A)F} (A) + X (4) F(A) AT — Q) 


[ad X? (A) +d, X? (A )Ja; i 
Ser ALA, X! +d,X?] 
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But X'(A), X2(A) are linearly independent and. moreover, d} + d, > 0. Therefore, 
d,X'(A) + d,X7(7) £0. 

(bj We assume in (a) that F(A) (a = 1,2) are linearly dependent. We now 
assume that F°(A}(a = 1,2) are linearly independent for some (hence for all) A> 0. 


In this case we can follow the notation and discussion in section 5.10. En, 


particular, Lemma 5.10.1 is still valid after some obvious modifications. 


Lemma 3. Let #(4) be a Q process possessing form (1). Then there exist row 
vectors x" 20 (a = 1,2) such that 2*@(A)el and a second-order square matrix 
R, =(r%) > 0 and quantities ps > 0 (a = 1,2,4 > 0) ([p,] = [0] if z is exit) such 
that 


[F(A)] = #,[a@(A)] + Cp, 1X7 (Wn (15) 

We introduce the notations | 
he = Ajat (A), X?] = Es, X” — X"(A)] the? = [ot X°] 2T: (16) 
H= (RTA = h”) At cc i (17) 


Consider a special case: [p,] = [0], < œ, that is 


(F(A)] = Alxol4)] 
[we, 1] < oo a=1,2 (19) 


Theorem 4. Let z be regular or exit, ao > 0. It is impossible that a Q process 
w(A) having the form (1) satisfies conditions (18) and (19), and moreover F “(2) 
(a = 1,2) are linearly independent. 


Proof. Suppose that Ņ(4) is a Q process having the form (1) given by (18) and 
(19), and moreover that F%(4) (a = 1,2) are linearly independent. 

As we have done in the proof of Theorem 5.10.1, by the norm condition and 
the resolvent equation for (A) it follows that [F(A)] has the form (5.10.33), 
that is, 


[F(A] =U-7,)" [2d] (20) . 


where row vectors #7 >0 so that [4,1] <1,.7,= {(@ X(A)]}. 


The y{4) must also satisfy the Q condition, that is 


O= lim A[X ALF] = lim AX (AYU — 7) [iael] (21) 
Since by (5.4), (5.5) and the dominated convergence theorem 


lim (一 学 人) t= lim ,9+=1 


À= o Ata n=O 
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Therefore, (21) holds for i> 0. For i=0, (21) becomes 


0=(% = 093 


Thus «* = 0. By (20) it follows that F%(4) (a = 1,2) are linearly dependent, and 
the proof is completed. 


Remark 


From this proof it can be seen that w(2) determined by (20) and (1) is a 0 
poe although it is not a Q process, where gi; = qy (i> 0,j€E), Go; = qo; + 
ao% - 


We now consider the general case of (15). 


Lemma 5. Let z be exit or regular, ag > 0. Suppose that F%(A) (a= 1,2) are 
linearly independent. For w(2) of the form (1) to satisfy the norm conditions 
and the resolvent equation it is necessary and sufficient that (å) can be obtained 
as follows: Select two non-negative row vectors &° (a = 1,2) such that &(A)el. 
Take a non-negative matrix 

过 0 51? 

La 


and take a constant p? > 0 (with p4 =0 if z is exit), and moreover, the following 
properties are satisfied: 


(i) either p? > 0, or p? = Oand Z and 2? furthermore are linearly independent. 
(ii) h < x (a #b). 


ca 
(ii) 51? <1,P1 <1, 5p ht -Ë a (a +b). 


Ag{Z — Zo) + 


cel=( "| 
p 


Wi=0 F + H+ CPU) 
[Pa] =U- F +#,+ PMU) EA] (22) 


whereas w(A) is determined by (1), (15) and (22). Here Æ, = (At)? # = (h”) 
(Af oo) are determined by (16) and (17) for &°. By (5.15) and (5.16) 


Finally, set 


and 


Uy =(U',U2)TfUuy = i eet oe. ‘ 
[V] =(U}, U3 TEU] (2-8. +}. (23) 
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For #(4} to have the forms (1), (18) and (19) it is necessary and sufficient that 
pr=0, hr <a. : 


Proof. To repeat the proof of Theorem 5.10.3, it suffices to make evident 
modifications. We must also notice that by Lemma 2.11.4, if a’ 20 so that 
a' (Ael, then h'! = lim; h? < oo and the proof is completed. QED 


We discuss the condition that y(4) of Lemma 5 is a Q process. By Theorem 4, 
certainly 


p?>0 or h?? = œ {24) 
To prove that (4) is a Q process, we must also verify the Q condition, that is 
lim [AX (AI Zr XDD + [p]X*(A)y) = 0 (25) 
where a 
inte 1+h}! ~ 5? 4h}? 
eye eee VD +R 4 p2ut 1 pap) 


By (24) and Lemma S(iii), we obtain lim}. „det Z, = +œ. Notice that 
hll < c,h” < œ (a # b), and it follows that 
1 eee eee a) 


lim 27! = lim -一 -一 i 
a> $ à> w det #, 5t? — h1? 1+h!! 


-(° +h!!! o) 
E 0 0 


Owing to (5.4) and (5.5), (25) holds for i > 0. For i = 0 the limit on the left-hand 


side of (25) is 
NI ee 
0 0 07 1+h" 


Therefore, (25) holds if and only if &! =0. Thus by (22) and (15) 
ó ¢ 
F(A)]=27,;' 
cae. err TA 
Therefore F°(4} (a = 1,2) are linearly dependent. This is contradictory to the 


linear independence of F7(A} (a = 1, 2}; thus the Q condition (25) cannot possibly 
hold. QED 


Combining this with Theorem 4, we have obtained the following theorem. 


Theorem 6. If z is regular or exit, ao > 0, then there does not exist a Q process 
w(A) which has the form (1) so that F!(A) and F?(4) are linearly independent. 


or pm ee -mo ener reat a ape 
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Remark 


From the preceding part of the proof of Theorem 6 it can be seen that (A) 
which satisfies the condition (24) in Lemma 5 is a Q process although it is not 
a Q process, where © 

Oy; 


oj = qoj + —— -i 


i>0,jek oe 
(i> 0,jeE) ee ar 


di;= fij 


6.9 THE CONDITION THAT x 中 (Jez 
Suppose x > 0. By (5.3) it follows that «@(A)el is equivalent to 


È afl — X14) X2] < cx (1) 
i=0 
In this section, we shall give the condition under which xẹ(å)el is directly 
determined from Q 


Lemma 1. Assume that dy 2 0, z is regular or exit. Then 


vf} 1 
lim .---— = 


ita Z— 72; u(z, A} 


(2) 


Proof. Using (3.4), we can give the proof by following that of Lemma 5.11.2. 


QED 
Lemma 2. Suppose a, > 0, z is regular. Then 
_ 1L-X}A)— X21) . 
jim AO EO oxy, 1] 3) 
i> w Zea Zi 
Proof. The proof is similar to Theorem 5.11.3. QED 


Theorem 3. If ao > 0 and z is regular, then the necessary and sufficient condition 
under which a@(A)el, that is, (1) holds, is that 


or 


$ xi(z2—2;)< 0 (4) 
i=0 
which is equivalent to 
y aN; <0 (5) 
where Ni is determined by (2.6). 


Proof. Applying Lemma 2, this proof can be provided by following that of 
Theorem 5.11.3. QED 
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Theorem 4. If ag 20 and z is exit, then the necessary and sufficient condition 
for a@(A)el is that (5) holds. 


Proof. This proof is similar to Theorem 5.11.4. | QED 


Theorem 5. If a9 20 and z is entrance or natural, them the necessary and 
sufficient condition for a@(Ajel is that 


al 
>, a < 0 l (6) 
Proof. The necessity follows from 


1- Xi) -X {4> 0 (i > 0) 
The sufficiency is obvious. l QED 


MAE y. e n EE EAn KO or! ite 
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PART TT MARTIN BOUNDARY AND ITS 
APPLICATION IN THE 
CONSTRUCTION THEORY 
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CHAPTER 7 


Martin Boundary and Q 
Processes 


7.1 > INTRODUCTION 


When the Q process is not unique, we must compactify the state space E so as 
to solve the problem of construction of the Q process. That is, we must adjoin 
some ‘boundary points’ to E so that certain requirements can be satisfied. In 
other words, we need to introduce and study the boundary of the Q process. 
The simplest compactification of E is one-point compactification. For instance, 
the unilateral birth-death process is done in just this manner, and moreover 
the one-point compactification is enough. However, in general it is not sufficient 
to perform the one-point compactification. For example, for the bilateral 
birth-death process, it is obvious that we must compactify E by two 
‘points’. 

In Feller (1956) a kind of boundary is introduced, which is called a Feller 
boundary. In his article, Feller (1957a) introduces the exit and passive boundaries 
for conservative Q, and then by applying these boundaries, he constructs all 
the Q processess that satisfy the systems of backward and forward equations 
simultaneously in the case that both the exit and entrance boundaries are finite. 
The method used by Feller is a purely analytical one. 

In Doob (1959) the Martin boundary of the Markov chain is introduced, its 
characteristic being that the Martin boundary is closely connected with the 
path of the Markov chain (henceforth the Markov chain will be abbreviated 
as MC). Doob proves the convergence of the MC’s path in the Martin boundary. 
In Dynkin (1969), Hunt (1960) and Watanabe (1960a, b), the theory of the Martin 
boundary of MC is further investigated and developed. In Kunita (1962), the 
Martin boundary is applied to a study of the instantaneous return process. But 
all the discussions in the articles mentioned above are conducted so that some 
restrictions are imposed on the Markov chain (e.g. if the MC is required to be 
non-recurrent, there must be a ‘centre’ at least). Though these restrictions are 
inessential, they need to be removed. In Hunt (1960) the introduction of standard 
measure can exclude the restriction that a ‘centre’ is needed. The following 
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formula in Dynkin (1969, section 9) 

GD Si 
人 
provides the way to rule out the restriction of the non-recurrence of the MC. 
Zhen-ting Hou (1974) derives the Martin boundary without imposing any 
restriction on the MC. 

In this chapter we first introduce the Martin boundary of general MC's, 
whose detailed description basically follows Dynkin (1969). Then we shall 
conduct extensive discussions in close association with the Q process. We apply 
the standard image introduced in Feller (1957a). It is similar to Definition 2.11.2, 
but narrower. We shali present and discuss in detail the A-image. Following 
the method in Kunita (1962), we derive the Martin exit and passive boundaries 
of the Q matrix without any conditions attached, and moreover, by applying 


K(i,j) = 


these boundaries, we further describe the general analytical expressions of the 


Q processes treated in section 2.12. 

The content of this chapter is absolutely necessary and fundamental either 
to the construction of the Q process by means of probability methods or to the 
probabilistic interpretation of the analytical method. 


7.22 MARKOV CHAINS 


We are given that (Q,¥,P) is a complete probability space', on which £ is 
defined to be a random variable with values of non-negative integers and ‘oo’. 
We say that X;(w) = {x,(w)’,n < f} (weQ,n is a non-negative integer) is a 
homogeneous MC or simply MC defined on the probability space (Q, F, P)? 
and taking values in the denumerable index set E. If for any integer n > 2, the 
non-negative integersO <t, <t,<---<t,,, andany i,,i>,...,1,4,¢£, provided 
P{x(t,)=i,,1<a<n} > 0, then we have 


PUX(tys D= inal Xa) = by: ] <a < n} = P{x(ty+3)= Lapin) = i,} (1) 


and moreover the value on the right-hand side is dependent only on tp41 — tm 
and not on ¢,. 
Write 


ph = P{x(n) = jix(0) = i} | (2) 


We call matrix (Pi) the n-step transition probability matrix of the chain and 


‘From now on when considering the sub-Borel field of 7 we always mean it to be completed 
according to P and will not make any more statement about it. 

2We take x(w) = x(n, œw), and shall leave out «w if it is not emphasized hereafter. 

31f(Q,.F. P) in the definition of the MC is relaxed into a finite measure space, X is likewise called 

a Markov chain. 
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simply write p, oP . The matrix, P =(p,,) is non- -negative and its row sums 
are not more than one. Every such matrix P may become a one-step transition 
probability matrix for some Markov chain X r. Therefore we also say the matrix 
P is a Markov chain. Note that 


p? =(P”); (3) 
We call 


d=1-Yp, ieE (4) 
j 

the stopping quantity of the chain. We call H = {ild; > 0} the set of stopping 

states. If H is an empty set, we say that the chain is honest; otherwise it is 


stopping. Evidently, for the chain to be honest, the necessary and sufficient 
condition is 


P{B=o}=1 icE (5) 


Here and afterwards we write P,{-}=P{-|x)=i},E,{°} represents the 
mathematical expectation taken with respect to P;. For instance, 


E{f,A}=E,fl, = | f dp, (6) 
A 
Here J, denotes the indicator function of the set A. 
Set 
n* =inf {nil <n Sfx, =i} (7) 
yn, = inf {n|O<n<B,x, =i} (8) 


We set inf Ø = co, where @ is the empty set. We write 


Sie = Pint =n} n>1 
Fi, Pin, =n} n20 (9) 
LEES SEd 

n=1 n=0 


We call f i (or f a the probability that the MC first visits the state j from the 


state i at the nth step, starting from the first (or zeroth) step. 
And we call f A or f,;) the probability that the MC reaches j from i at the 
nth step for some n> 1 (some n 2 0). Obviously 


L f” = i (n> 1) fi =f; i 
六 = 大 -1  fy=0 mel) (10) 
Fi Pad ay Saski SSi 

k 
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If f*>0(i#j) we say that the chain can lead to j from i, and write i=j. 
Set i= i. If ij, ji, we say that i and j communicate and write i<j. Assume 
Cc E; if any two states in C communicate, and furthermore p, = 0 {ieC) for 
any keE — C, then we call C an irreducible class. If I = i he = Í, then we say 
that the state i 1s recurrent. 


Theorem I. Write 


Gi.= Ep (11) 
n=0 


Then 


G({i j) =f, GUD G(i,i) = (12) 


1—f s 
Especially, for i to be recurrent, the necessary and sufficient condition is 
G{i,i) = œ. 


Proof. Write 


ôli) = 6,, (13). 
Then 
g 
pPr=E6(x,) ~ GUJ=E, Y ò) (14) 
n=0 
Write 
Am = (Xo Fj, Xi Æj. : -s Xm—1 Æj, Xm =j) 
Then 
P(A DESP P(Am Xm =DE S, 
Therefore 


£ 
Gij) = E, > ôx) 


n=0 


m=0 k=0 
ae m = . > 
m=0k=0 


MARKOV CHAINS 153 
The proof of the second formula in (12) can be found in Zi-kun Wang and 
Xiang-qun Yang (1988, section 2.2, Theorem 1). QED 
Remark 


If j is non-recurrent, then G(i, j) < oo; thus VDA ER, <œ P, almost surely; 
that is, with probability 1, the number of times that the chain visits j 


is finite. 


Theorem 2 (Decomposition theorem of state space). The state space E of the 
MC has the following unique decomposition: 


sav( U e.) (15) 
ae of 


where Eo is composed of all the non-recurrent states. .% is an empty set or finite 
set or denumerably infinite set, and moreover O¢.o/. Every E, (ae.%) is an 
irreducible recurrent class. 


The verification can be seen in Zi-kun Wang and Xiang-qun Yang (1988, 
section 2.3, Theorem 1) We point out that every stopping state must be 
non-recurrent, that is, 


neyedn sitet, (16) 
j 


The chain X, = {x,,n < $} moves as follows: If xg is in some E, {aes}, then 
P= œ, and the chain will move in E, forever, and moreover visits every state 
in E, infinitely many times. If xoeEo, then either B < oc, and at this moment 
there must exist xpe H; or $ = oo, and in this case the chain either moves in Eo 
forever, or gets into some recurrent class E, at some step, and then moves in 
E, forever. As for further consideration of Ey, we have the Blackwell decompo- 
sition theorem below. 


Let 
Qo =(B = 0) Qp =(P < æ) (17) 
Provided A c E, set 
L(A) =Q,,nlimsup {x EA} 
(A) = Qnliminf (x64) (18) 


If P,{ .2(4)} =0 (ieE), then we call A a transient set; if P,{ L(A)} > 0 for some 


154 MARTIN BOUNDARY AND 0 PROCESSES 


icE, then we say that A is a sojourn set. Suppose that A is a sojourn set, and 
moreover, Pi{ &(A)} = P;{ #(A)} (ieE), then we say that A is an almost closed 
set. When A is a transient set or an almost closed set, we write ¥(A) for any 
one set that is equal to #(A) with the exception of a P,-null probability set 
(for all i). 

Assume A to be an almost closed set. If for any B c A, either B or A — B is 
a transient set, then we call A an atomic almost closed set. If for any B c A,B 
is not an atomic almost closed set, then we call A a completely non-atomic 
almost closed set. 

The following is the Blackwell decomposition theorem. 


Theorem 3 (Chung, 1967, 1, 17, Theorem 4). The state space E has the following 
decomposition: 


B= Ay+( U Ae] (19) 


ae. 


where A, is a completely non-atomic almost closed set, and so can be dropped. 
.f is an empty set or a finite set or a denumerably infinite set, and moreover 
O¢.of. A, (a€.o/) is an atomic almost closed set. Furthermore 


P{P(Ay)} + 2 P{L(A)} = P(Q.) (20) 


ae of 


If we rule out the difference of a transient set, the decomposition (19) is unique. 


Note that in the decomposition (15) every irreducible recurrent class is an 
atomic almost closed set. 


7.3 MARTIN BOUNDARY THEORY 


The study of the ultimate behaviour of the path of the MC, Xr = {x,,n < B}, 
that is the behaviour of x,, when nf p, gives rise to the Martin boundary theory 
of the MC. Applying the boundary theory, we can also deseribe all the excessive 
and harmonic functions relative to the chain. Assume that the one-step transition 
matrix of Xr is P =(p,,). If the stopping state set H is not empty, we can select 
A¢E, and let 


Paa =! Pai =0 pia=1— Pi icE (1) 
j 


x, =A ifp<cao,n>fp (2) 


Then {x,, n 2 0} isan MC, whose one-step transition matrix is (pi,i,jeE VU {A}). 
From now on it is to be understood always like this. 
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7,3.1 Excessive function and excessive measure 


Assume u to be a function on E!. The function Pu is defined as follows: 
(Pu); = 2 Piju; 
j 
Assume that v is a measure on E. The measure vP is defined like this: 


(vP), = 2 ViPij 


Definition 1. A non-negative (including + 00) function u is called P-excessive, 
if Pu < u; it is said to be P-harmonic if Pu =u. We write the class composed 
of bounded harmonic functions as .@*, and denote the class of harmonic 
functions bounded by k by æ + {k} 


Evidently, if u is excessive, then P"u <u for all n. 


Definition 2. A non-zero excessive (or harmonic) function u is said to be minimal 
if u=ut +u? and moreover u! and u? are excessive (or harmonic) functions. 
Then u = cw (a= 1,2), c° is a constant. The non-zero harmonic function u is 
called completely non-minimal if, for any non-zero harmonic function v < u,v 
is not minimal. . 


Definition 3. A (non-negative) measure p is called P-excessive, if uP < u; it is 
said to be harmonic if uP = p. 


Assume that u is a P-excessive function on £ and furthermore let u(A) = 0. 
Then (u;,ic¢EWU{A}) is likewise excessive with respect to 《Pi i,jEeEU{A}). 
Applying the Markov property of Xr and the excessive property of u: 


ELu(x, ;i)lxos Xs,... Xa] = Elen a We] = È Panis < u(xn) (3) 
j 


Hence {u(x,),1 20} is a supermartingale while {—u{x,),n 20} is a sub- 


` martingale, and thus 


Eu(xo) > Eu(x,) > Eu(x2) 2 … (4) 


Assume 0 <a < b. Let Uy be the number of times that the sequence u(xXo),...， 
u(xy) goes down across the interval [a,b], that is the number of times that the 
sequence passes from the right side of the interval [a,b] to its left side, and 
hence the number of times that — u(xo),..., — u(y) passes from the left of the 
interval [—b, —a] to its right. According to Zi-kun Wang {1965a, section 1.4, 


1! Hereafter u; will also be written as u(i); similarly Po will be denoted by p(i, j) and so on. 
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Lemma 3), or Doob (1953, Ch. VIF, Theorem 3.3), 

E[—u(xy) i by]* 
(一 要 一 (一 中 

_ Elu(xy) — 6)" 


b-a 


EU, < 


MEN) 
b—a 


Eu(xo) 
S 5 
< T (5) 


Let y be the number of times that u(xo), u(x,),...,u(X,),... moves down across 
the interval [a,b]. Then vy Tv. Accordingly 


Ev< Eu(xo) (6) 
b—a 
In particular, 
pya M (7) 
b—a 


Hence if ufi) < co, then E;v < œ, and therefore P, almost surely’ v < œ; that 
is, the number of times that {u(x,),n > 0} goes down across [a,b] is finite. Use 
the following fact: if the number of times that a sequence goes down across any 
interval [a,b] with rational ends is finite, then the sequence must have a finite 
or infinite limit. Therefore, if u(i) < oo, then there is a limit 


E = lim u(x,) Pi almost surely (8) 


nw 


But 
Eu(x,) = 5 pul j) < uli) 
J 
so that according to Fatou’s lemma, 
Fié < u(i) 


Consequently we have P, almost surely č < œ. So we have proved the theorem 
below. 


Theorem I. Assume u to be an excessive function, u{i) < œ. Then there almost 
surely exists a finite limit lm ,u(x,) on Q,. | 


‘If P is a probability, ‘P almost surely’ means ‘with P probability one’. 
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Theorem 2. Assume that the states of the MC communicate. Then the chain is 
recurrent if and only if all its excessive functions are constants. 


Proof. Suppose that u is excessive. If for some j we have u( j) = œ, then for any 
i, according to the fact that i and j communicate, there must exist n such that 
pi; > 9, thus 


Ui 之 pulk} > piu( j) = 2 
k 


Hence u= œ. And therefore we only need to consider the finite excessive 
function u. 
Let us assume Xr to be recurrent. By Theorem | there exists a finite limit 


lim u(x,)=¢ P; almost surely 


no 人 


According to the recurrence property of Xr and the fact that the states 
communicate, for an arbitrary j we have 


P(x, =j for infinitely many n) = 1 
so that 
P(E =ulj))= 1 
Since j is arbitrary, 
P(g = u(k))= 1 


for the state k. It follows that u(j) = u(k), that is, u = constant. 
Suppose that all the excessive functions of X y are constants. Fix k and write 
u; = fir. Then in accordance with the notation in (2.7), 


È Piss = pi(ng < 0) = SES Sin = Mi (9) 
j 
This means that u is excessive, therefore u = constant. But it is obvious that 


u, = fy, = 1; hence u = 1, that is, f, = 1 for all i and k. Taking i #j arbitrarily, 
by (2.10), 


l= f=) Pla F Pim 
i= 2 ie 2 Pj= I 
J J 
that is, iis recurrent, so the chain is recurrent, and the proof is completed. QED 


The following corollary does not require the condition that the states 
communicate. 
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Corollary 


When j is fixed, fi; as a function of i is an excessive function. 


Proof. From (9) the corollary follows. | QED 


Corollary 
Assume u to be an excessive function; then u takes the constant value in each 
recurrent class. 


Theorem 3. For any measure y, yG is an excessive measure. Especially when i 
is fixed, G(i,/) is an excessive measure. 


Proof. Since 


it follows that 


(yG)P <yG QED 


Corollary 


Suppose that there is a measure y such that X;y;f;;> 0 (jeE), and h is an 
excessive function. If h is y-integrable, then h is a finite function; if $y; =9, 
then h = 0. 


Proof. Since P"h <h, it follows that 
Yipih < 2 .72 Pohj < Vv 
i j i 
Because of the assumption with respect to y there exist i and n such that 7;p;, > 0 


for every j. Therefore if 5 ,yih; < œ, then h; < œ; if 5;7;hi = 0, then h; = 0. The 
proof is concluded. QED 


7.3.2 Density function of an excessive measure 


Suppose that the MC X, has an initial distribution +’. In order to emphasize 
the dependence on y we had better write the measure P as P, and the 
mathematical expectation E as E,. So the mathematical expectation of the 


'The total measure of y may not necessarily be 1. 
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number of times that the chain X+ is in the state j is 


n=% Gij) 


The measure 
"=G (10) 


is a P-excessive measure. 
Suppose D is a finite subset of E; let tp (or simply t) be the last exit time 
from D of the chain X 7, that is, 


t=sup{n:0<n<fp,x,eD} (11) 


If for all n (0 <n < f), we have x,¢D, then we leave t undefined. 
Write 


Lpli) = P(t =0) = P(xoeD, x,€D for 1 <n < B) (12) 


so that Lp(i) = 0 for iD; when ieD, Lp(i) is the probability that the chain leaves 
D at the first step and will never come back to D. Thus when ieD and moreover 
when i is recurrent, Lp{i) = 0. 

Evidently, for any jeE 


m=0 
= Š peL) = GDL) (13) 
m=0 
Z GUL) = ¥ Pile, =) < | (14) 


From (13) it follows that 
P(x, =j) = n()Lp(y) 


Suppose n is a non-negative integer. When t <n, or T= %, OF T is undefined, 
we shall set x, = A. Assume ig, i,,...,i,¢£; moreover write 


Rii,, . : -s io) a Plins Law et PCi, io) 


where y = yG (15) 


Then it follows that 
L 
PAX, =H, X, ;一 让,X = n= 》 PAT = IM, Xm=io Xm- 1 = bao Xn in) 
a . 
= 》 P” "(i)R(i,,...,io}Lp(io) 


= G(i,i,)R(i,,-- sto) Leplio) 
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Multiplying both sides of the above formula by y; and summing over i we obtain 
P(X, = losses Xen = bn) = MERC. do) Lplig) (16) 


When n= 0, the formula above becomes (15). 


Lemma 4. Suppose every state of the chain Xr is non-recurrent and let u be a 
non-negative function on E; set MA)} = 0 also. If uy = (ut), je E) is an excessive 
measure, then with respect to the measure P,, {u(x,_,),n 20} is a 
supermartingale relative to {x,_,,n 20}. That is, 


Ea — | ss 900+ Xa 1) SMX, gp) (17) 
Proof. Since uy is an excessive measure it follows that 
2 A Plin in) < uli, NG, 1) 


in 


Thus 
2 Nid RO, oo Lp(io)u(i,) < ni ~4 RC, -1 ig)L plio)uli, = 1) 


Noting (16) we obtain {17) from the formula above. The proof is terminated. 
QED 


The function u in Lemma 4 is the density of the excessive measure p = un 
with regard to y. 
Let K , denote ail non-negative functions u satisfying the following condition: 


S = sup {£,u(x,,): finite D c E} < oo (18) 


Note that when tp=0o or Ty is undefined, x,,=A, and. furthermore 
HUA) = 0. 


Theorem 5. Suppose that every state of the chain Xr is non-recurrent, and 
assume that ue K, and that un is an excessive measure. Then on Qa, there exists 
P, almost surely a finite limit 

lim u(x,) 


n>% 


Proof. Let vy be the number of times that u(x,),...,u(x,_,) passes down across 
[a, b], that is, the number of times that u(x, _,,),-..,«(x,) moves up across [a, b]. 


By (5) 
E,u(x,) 


E py < 
$ b—a 
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Let pp denote the number of times that u(x0),..., u(x,) goes up across [a,b]. By 
the non-recurrence property when D is finite, for P, almost certainly t < œ; 
hence ryt vp (N — œ). Therefore 

Bese o 


Y 
b—a 


Since ueK, it follows that 
Evp < S/(b — a) 


Let v represent the number of times that u(xo), u(x1),..., u(xn),... passes up across 
[a,b], then vy tv {D1 E), and therefore 


Ev < SAb—a) (19) 


Consequently PP < oo)= 1, thereby there is P, almost certainly a finite or 
infinite limit ¢ = lim,.,,, u(x,). It remains only to prove that P, almost surely 
holds č < o. 

Suppose v(c) is the number of times that u{x),...,u(x,) moves up across 
[c, 2c]. Let 


lim fc) = 5 
Evidently 
(E = 0) S621) 
so that 


By (19) and Fatou’s lemma we obtain 


P(E = 00) < E, lim v(c) < lim E,v(c) 


crm +o 
_ Ss 
< lim -=0 
c~w c 


and the theorem is proved. 


7.3.3 Martin kernel 


Definition 4. We call the measure y = (y, i€ E) the standard measure of the chain 
X,or P if 


Lv <% 0< 2 Wij (20) 
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From now on when considering a Martin boundary we always fix a standard 
measure y. By Section 1.4, the measure generated by the initial distribution y 
and the matrix P =(P,,) is represented by P,. Since P, = >);P. it follows that 
if y; > 0 (iek), then P(A) =0 if and only if P(A)= 0 for all i. Obviously, 


0< AEN yify < oo (21) 
Definition 5. We call 
fo fi; ` 
K(i, j) = = =- (22) 
A; Shey 


the Martin kernel of the chain 


By Theorem 1 we have 


A,;G(j, j) = (6); (jeEo) 
Therefore 
Wi he ifjeEo (23) 
n(j) 


where y =7G and Eo is the set of all non-recurrent states. 

By the first corollary to Theorem 2 and Theorem 3, when j is given, 天 (月 
is an excessive function. 

According to the definition and the last formula of (2.10) we have 


K(i, j) < re K(i, j) < 4, È yik (24) 


Theorem 6. Suppose p is a totally finite measure. Then on Q., there P,-almost 
surely exists a finite limit 


lim > (DK(i, x,) (25) 


now i 


In particular, for any i, on Q,, there P,-almost surely exists a finite limit 


lim K(i, xn) (26) 
Proof. By (24) we have 
2 HOKE j} < > (iA; `< oo (27) 


Suppose that E, is an irreducible recurrent class. When the class property of 
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E, is taken into account, the states in E, may be considered to be equal. For 
instance, every state in E, is equal to one state ča When jeE,, fi;is independent 
of j and is denoted by {{é,). Thus K(i, j) is also independent of jeE,, and is 
denoted by K(i,é,). Therefore when the chain gets into some irreducibly recurrent 
class E, at a certain step, for all sufficiently large n, 


È MK (i, x) = = Lak (i, ča) < 00 


Consequently the limit (25) exists and is finite. 

What remains to be proved is: when x,¢£, for all n < $ = æ, the limit (25) 
exists and is finite. In this case we only need to consider the non-recurrent chain 
on Eo, Xr = {x,,n < B}, where B = sup {n: x n€ Eo}. The initial distribution of +e 
is (ya lE Eo); the one-step t transition matrix is P = (pipi, jE Eo); and as for P, we 
have the corresponding f= fi K(i, j) = K(i, j) (i, je Eo). Moreover, 


DHDKG, ND) = > OK, j) jeEo 
i iEEo 
Accordingly we might as well suppose that every state of the chain P = (p;p i, JEE) 
is non-recurrent; then we shall prove that the limit (25) exists and is finite. 
Letting u(j) = >ju()K(i, j), and noting (23), we have uy = uG, while gG is an 
excessive measure. Now we (ee to prove ueKy. Actually by (15), 


Elx) = E Px = jm) 


= E? I DLo(D) 
= SMG DLA 
By (14) | 
E u(x) < 2 ui) < oo 
Thus | 


sup {E,u(x,,,): finite D c E} < ¥ pli) < oo 


That is ueK,. The conclusion of the theorem is immediately reached by an 
application of Theorem 5, and the proof is completed. QED 


7.3.4 Martin boundary 


In the theory of the Martin boundary we usually regard every state in the 
irreducibly recurrent class E, as one and the same state ¢,, and we still 
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write 
E = Epu {čne A} (28) 


We arrange arbitrarily the order of the E in (28): E = {e,,e,,...}, and write 
N(e,,) =m. Let i 


d(i, j) =1277® —27Y®] + X | K(s, i) ~ K(s, jA, 2779 (29) 
where A; is defined by (21). Then d is a metric in E and induces a discrete 
topology from E; moreover d(i, j) < 3 (i, jeE). Completing E according to the 
metric d we obtain the complete metric space E*. 


Definition 6. We call CE = E* — Eo the Martin boundary of the chain P. The | 


Borel field generated by the open sets in E* is written as &*. An element in &* 
is called a Borel set in E*. And an &*-measurable function defined on a Borel 
set I is called a measurable function on IT. 


Evidently, 
CE =(0E), U(CE), (GE), = {čna A} 


Following the definition of the metric d, we evidently have the following. 


(GE), = ôE — (3E), (29a) 


Theorem 7. An infinite sequence {j,} in E is a fundamental sequence in the 
metric space E if and only if 


(i) lim, ,wo N{j,) exists (finite or infinite); 
(ii) for every ie E, {K(i,j,)} is a real Cauchy’s fundamental sequence. 


By Theorem 7 we can extend the domain E of definition for N(i) to E*; 


therefore 


N(¢} < œ (Ce(CE),) 
N(¢) = oo (če(0E)) 


For every i, K(i, j) as a function of j can be continuously extended to E*, that is 


(30) 


K(i, ¢) = lim K(i j) 
d 
ig 


By (24) and Fatou’s lemma, K(-, €) is an excessive function, and 
i 
K(i, 2) < a: > 7K(i, 2) < | EeE* (31) 


Thus (24) is a special case of (31), and the second formula above is an equality 
for te Eo U(6E),. 
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Thus (29) can also be extended to ieE* and jeE*; hence Theorem 7 is still 
correct if E in Theorem 7 is changed to E* and { ją} is an infinite sequence in E*. 


Theorem 8. E* is a sequentially compact space. 


Proof. By Theorem 2, §3, Chapter 1 in Guan (1988), for the metric space the 
concept of sequential compactness and that of compactness are identical. 
Therefore it suffices to prove the sequential compactness. 

Suppose {¢,} is an infinite sequence; let č EE*. Then we can surely select a 
subsequence of {¢,}, which is also denoted by {¢,}, such that lim, N(¢,) exists 
(finite or infinite). By (31) for every ig E we have 


K(i, Eal < 1/A; 


Applying the diagonal process, we can select a subsequence {€,,} of {č} such 
that for every ieE, {K(i,é,,)} are all fundamental sequences of real numbers. 
According to the paragraph preceding Theorem 8, the sequence {£,.} must 
converge in E* to some point teE*. This is just the sequential compactness. 
The proof is terminated. QED 


Theorem 9. For P,-almost all weQ either 


xgeH 让 有 < œ (32) 
or there exists a limit 
d— lim x, =x,,€0E if 8 = œ (33) 


Here 
-fi Z p< i} 


Proof. On Qp, xpEH is obvious. On Q, as Theorem 6 has already pointed 
out, there P, almost surely exists a finite limit 


lim K (i, x,) for ali ie E 


net 


is the stopping state set. 


Thus there exists a limit 


d— lim x, =x,,¢E* 
n>n 
If the chain gets into some recurrent class E,, then x,, = č¢,EĝE. Otherwise 
the chain will move in E, forever. As the number of times that the chain stays 
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at any non-recurrent state i€E, ts always finite. it follows that x Eo, and 
hence x ,.€E* — Ep = 2E. The proof is concluded. QED 


7.3.5 Distribution of ultimate states 


By Theorem 9 the ultimate state x, is defined P,-almost surely. We write the 
distribution of x, as follows: 


HY) = wl) = Px,eT) reé* ` (34) 
Then the mass of u is distributed on HUGE. 


Theorem 10. Suppose that u is a continuous function or a non-negative Borel 
function on E* Then 


Eiul(xag) = | K(i, s)u(s)u(de) (35) - 
HUE 
Exp pen = YG pu! Z Lr) 36) 
Ejlp) poo = | K(i, Gueule) (37) 
CE 


In particular, 
PA{xgeT) = | K(i, Eu(deé) TcHuoE (38) 
r 
Páx =j)= Px =j <œ) 
= Gli, ai = Eps) jeEo (39) 


= | K(i, ou(de) cde (40) 
r 
uD =P == = EP] jek, (41) 


Proof. When €,€(0E), 
Pilxg = a) = filed) 


WE.) = o> ysf A(E,) 
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So 
P(x, = č) = K(i, enue) če(ĉE), 


Hence 


Eiuxp)l (ces; -| K(i, Could) (42) 
cE); 
Secondly, when je Ep, | 
Pi(xp =j) = Pix =j, B < œ) 
= È Po =jn=p)= 


2, Em) 


From this (39) follows. Then (36) and (41) foilow from (39), and furthermore 
from (39) and (41) we obtain 


Eiu(xp)ls -wu = | K(i, Susu(dé) (43) 
H 
Thirdly, comparing (13), (15) and (22) we have 
PAX, =f) = K(i, JP (x, = j) JEE (44) 
Hence 
Ewu(x,) = 2 uPAx = j) = 2 GKE NP = j) 
= E,Kti, x,)u(x,) (45) 


Let DTE, then ty} f, x,,, +x, when xgeH U(CE).; when x,e(GE),, if only D is 
sufficiently large, that is, when D and (2E), have some non-empty intersection, 
Tp = 0%. According to the supposition x,, =A, u(A)=0. Thus when u is a 
continuous function on E*, noting the first formula of (31) we get 


Exp)ly nvr = Erk Ct, xula senon = | K(i, c)u(g)u(dc) (46) 
HU(GE)2 


From (42) and (46) it follows that (35) is valid for the continuous function u 
on HUOE and therefore it also holds for the non-negative Borel function u. By 
(35) and (43) we derive (37), and the proof is completed. QED 


Theorem II. Assuming that u is a continuous function on E*, then 


i u{C)u(de) = Eu(xp)= 2 ul j)n( cal ~ > Dn) + lim 2 r(i)pru(j) (47) 


n>w if 
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Proof. When u is a continuous function on E*, 


Ewu(x,,) = lim E,u(x,) = lim (p'u); 


atx a+ wD 


By this and (39) we obtain (47). QED 


7.3.6 4-Chain and the Martin representation of an excessive function 


Suppose that h is a P-excessive function, and moreover is y-integrable, that is, 
Diyihi < œ. On account of the corollary to Theorem 3, h is finite-valued. We 
write 


i, jeE* (48) 


E* = {i:h; > 0} ph. = 和 
By the excessive property of h we can easily get 
fi, =9 i¢ Er, jeE* 


whereas P* = (pf, i, j€£") is a matrix that is non-negative and whose row sum 
is not more than |. The MC Xr = {x,,n < $}, whose one-step transition matrix 
is P*, is called an h-chain. When h = t or constant, the h-chain becomes an MC 
whose one-step transition matrix is P. Henceforth, all the characteristics of the 
h-chain will be preceded by h. For example, 


Gi = (P*y 
n=O 


measure P* and so on. 
Clearly, the measure yf = yih; (ic E") is a standard measure for the h-chain, 
and furthermore 


Pi} = 7 i, je E" (50) 

Hence 
Go j) = PD i jeE! (51a) 
n'i} = nih; jee" (51b) 


where n" = y"G", n = yG. 
By (51a) it can be seen that for an h-chain the state decomposition theorem 
in Theorem 2.2 takes the following form: 


E* = Bsu( U rt) l (52a) 


ac of 
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where 
ELS EAE, E! = EnNE, acd (52b) 


Let the stopping state set for the h-chain be denoted by H*, that is, 


m= friem >» P< 中 -es (52c) 
JeE* jeE 
Then we have 
st? GE, (52d) 
Suppose i, je E". By (49) 
hn Wr ph oh h tes I ” h. = iff (53) 
= Pi Phas P= 2 PijPirja Pih 


where 3” represents summing j, #j, jeE* 1<1<n—1 while $” indicates 
summing j; #j, j,EE, 1 <1<n—1. By (51b) we obtain 


A, 
J ih i, je E (54) 
h; 
Thus 
At = DVS ig = L Sugh = Ah, jeB (9) 
ieEn ieE 


Consequently the Martin kernel of P* corresponding to y" is 


fh Kij) 
AO h 


了 


K*(i, j) i, je E” (56) 


From the foregoing formula we can see that if {K"(i, j,)} is a Cauchy sequence 
of real numbers, then so is {K(i, j,)}. Therefore by Theorem 7 we can find that 
the Martin topology of the h-chain is identical with that of the 1-chain. Hence 
the Martin sequentially compact space E"* of the h-chain can be looked on as 
a closed subspace of E*, that is E"* is the closure of E* in E*. And the Martin 
boundary ĝE* of the h-chain is precisely the boundary of E” in E*, ie. 


GE" = dENE™ 


Suppose that {x,,n < £} is an h-chain; let the initial distribution be y". We 
write An for the distribution of the ultimate state X,- The support of p, is 
contained in H"U@E*, but u, can be looked on as a measure on E** and more 
reasonably as a measure on E*, that is 


balT) = py.(xpeT) Deé* (57) 
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And it follows that 
ua(E*) = 2 yiPi(xseE*) = 


pA ti a i (58) 


u(E* — E™*) =0 (59) . 


Theorem 12. Assume u to be a continuous function or a non-negative Borel 
function on E*, then when ice E”, 


1 

Eju(x,) = h | K(i, cucu (dc) (60) 
iw E* 

1 

Eru(xp) Ly ao > h. > Gli, ath = > Puts) (61) 
t l z 
Efu(x,)Lg - » 7 :| K(i, Eula(dé)} > (62) 
id 2E | 
Especially, when ie E*, 
l 
Pise D)= > | K(i, ula) (63) 
iJr 
Pi(Xg =f) = Pi(xp =j,B < oo) 
le A 
=) 6 a(t -Tp .) jeE, (64) 
Pixel) = P,(xgel, B = œ) 
=; | KG Eud POE (65) 
ivT 
W=- Spats) JEE, (66) 
If u is a continuous function on E*, then | 
| u(d)u,(dé) = > umh 一 六 po] + lim » yiprhau (67) 
E* i 5 n> ow ij 


Proof. Applying the conclusions of Theorems 10 and 1t to the h-chain and 
noting (56) as well as ES c Ep, we can prove the theorem. QED 


Theorem 13. Suppose that h is a y-integrable excessive function. Then 
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hi = | Ki, Eun AE (68a) 
E* 
j s cE 


Proof. Letting u = 1 in (60) it follows that (68a) is valid for ic E". Suppose i¢ E*, 
that is h; =0. By (49) we have K(i, j}=0 (jeE"), so that K(i č)=0 (teE'*). 
Noticing (59), 


| K(i, Su(de) = | K(i, C)u{d¢) = 0 
E* Eh* 


Therefore (68a) is also true for i¢ E". 
Using (66) we obtain (68b) from (68a). The proof is terminated. QED 


Remark 


The measure y, is called the spectral measure of h whereas (68a) is said to be 
the Martin representation of the excessive function A. 


7.3.7 Essential Martin boundary 


Suppose jek, then K(-, j) is an excessive measure; hence the measure Hgy, p can 
be well defined. By (58) and (24), 


Hg (E) = E rK, j) = 1 (69) 


Theorem 14. Suppose 6, is the unit measure concentrated at j, then 
Hep =O;  JEEoU(OE), (70) 

Proof. Write h= K(-, j}. When je Eg, then 

G-ed y 5,0) 


iK Ea i i 
27 ou nj) n(j) 


and so 
h; — (ph); = 1/n(j) 


Thereupon by (66), Hx, lJ) = 1. Observing (69) we have (70). 
When j = č, (ae), we have 


K(i, Sa) = filSa)/A(Sa) 


and 


=) ypt(xp =f.) = FSE) 
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where ye represents summation over E*. Consider (54) and A(é,) = 天 (< 上) 一 
1/A(é,) and then 


(CaF 
oa) = 2 MRS 


= 2 VSE Wis = | (71) 


Again applying (69) we obtain Hke . = z, The proof is concluded. QED 


Definition 7. Let 
= {€:Ce0E, pg.» = 5} (72) 


B is called the essential Martin boundary. If čeB and u(t} > 0, then € is said 
to be an atomic boundary point. The set B, composed of all the atomic boundary 
points is called the atomic boundary of the chain; B, = B — B, is called the 
non-atomic boundary of the chain. B= B, UB). 


By Theorem 14, é,eB. Again since 


HE.) = p Axs = Ča) = > YiPilXp = Ča) 


= $, yi féa) = Ala) > 0 


it follows that every recurrent boundary point €, is an atomic boundary point, 


that is, 
(GE), € B, l (73) 


Theorem 15. Suppose teB, then K(-,&) is a harmonic function; moreover 


Lirik) =1 ceB (74) 


Proof. Write h= K(-,é); since p, =ô; from (68b) we get Gf =0, where 
f =h-— ph. Accordingly, 


Eas = 


and thus f = 0, That is, K(-, £}(€€B) is harmonic. Again by (58) and (3) when eB, 


¥ v{Gf);=0 
J 


l = py, ,本 一 一 和 KG <i 


From what precedes, (74) follows. The proof is completed. QED 


rr 一 一 一 一 一 一 一 一、 一 一 一 一 一 ~ 一 一 一 一 
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Theorem 16. B is a Borel subset of GE. For any y-integrable excessive function 
h, we have 


WOE — B) = 0 


Proof. As čeĝE, by (58) and (31) 


Hga E*) = VK) < | 


so that 


B = {č:čeðE, tty. (6) = 1} (75a) 
For čeðE, by (67), 


Hke alë) = lim i: e7 male i td) 


m— on 


= lim Doon( Ki (j, č) — È PiK 60) 


m>w j 


+ lim lim 5 yp} K(j, Oe "a (75b) 


mow no i,j 


From this we know B is a Borel set. 
Suppose €e0E; simply write K = K(-, č). Assume % and w are both continuous 
functions on E*, m 20, n 20. Then 


= $ wh py ope ws) 


i j.s 


= > 区 站 K] VERY m) 
ij 


E (Xn) Xatm) 


Let m— œ; by an application of (62) we have 


EnO =È vpih P| K'O, WS) ldë) 


AE 


2 VKG, Opie w(tde) 


GE ff 
-| EF (x )(E) (de) (76) 
JE 


Considering 


Fiat.) = | (0) 4x40) 
CE 
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and letting n— æ in (76), we obtain 


| ASWAC) HE, de = | (f POeK ac een 
GE CE aE 


Since the continuous function Ņ can be arbitrarily selected. from the formula 
above it follows that 


9 人 (e) = | PCke atdi) 
E 


holds for y,-almost all čeðE. In particular, taking ¢ as 
pa 人 一 end m= 1,2,3,... 


we get that 


i= | emo (dC) m= 1,2... 
CE 


holds for y,-almost all čeE. Letting m— œ in the foregoing formulae we have 
that 


1 = Prelë) | 
holds for An almost all čeðE. From (75) it follows immediately that 


H,(CE — B) = 0. The proof is completed. QED 


Corollary 
Write the essential Martin boundary of an h-chain as B*, and then 


B* = Bo E’* 
Proof. Similar to (75), 
B= {E:€E0E", Han. ofS) = 1} 


However GE" = En E*"*. When €€0E* according to (75b) we may calculate 
Hen aS): 


Hgh alé) = lim > eon KY j= > pi K"(s, a) 
m> w jeEn seEh 
+ lim lim 2, yip K'O, de me? 
moo næ i,jekh 
Noting (49)-(52) and (56) we can see that the right-hand side of the formula 
above becomes the right-hand side of (75b); thus pg... 9(€) = Hxn..a(¢). From this 
we can prove B* = Br E**, The proof is completed. QED 
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Because of Theorem 16, Theorem 9 can be strengthened as follows: 


Theorem 17. Suppose Xz = {x,, < f} isa 1-chain. Then for P -almost all weQ, 
either 


x,eH if B< oc (77) 
or there exists a limit 
d— lim x, =x, EB if B = cc (78) 


Equations (60) and (62) can be strengthened like this: 


Eru(xp) = 2 | K(i, Eule)un(dé) (79) 

i EquB 
Etu xolg- u =; | K(i, Ou Ede) (80) 

iv B 

Especially 
Ean = | K(i, čju{č)}u{dč}) (81) 
Eou B 

Ewulxp)lg-.. = | K(i, eué)u(de) (82) 

B 


7.3.8 Uniqueness of Martin representation 


Theorem 18. Every y-integrable excessive function h can be uniquely 
represented by 


h; = | K(i, C)A(d¢) (83) 
EguB 


where A is a totally finite measure on the Borel set E,UB; therefore 4 = py. 
Conversely, given any arbitrary totally finite measure 4 on Eo B, (83) defines 
a y-integrable excessive function. This function is harmonic if and only if 
A Eo) = 0. 


Proof. Let u=1 in (79). It follows that h has the representation (83), where 
A = Hp is a Measure on Ey UB, and the total finiteness of u, can be derived from 
(58). 

Now we assume that h has the representation (83). We proceed to prove 
A=, For the continuous function u on E*, applying h and K(-,¢) to (67) 
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respectively and noting (83), we have 
| wo- | (| Def) Jaa 
E* Eou B E* 
But Hke n 一 0 (CEE U B); hence 
| u(c)p,(d¢) = | ue)Ade) 
E* Eou B 


Because the mass of x, all concentrates on Eo VU B, on account of the arbitrariness 
of u we obtain A = u, from the formula above. | 


Since K(-,€) is an excessive function, and moreover (31) is valid, it follows ` 


that (83) defines a y-integrable excessive function. By Theorem 15, K(-, č) (eB) 
is harmonic; therefore if A(E,) = 0, then the h in (83) is harmonic. Conversely, 
assume that h in (83) is harmonic. By (66) we obtain yu,(/) = 0 for all je Eo,, that 
is, AEo) = us(Eo) = 0. The proof is completed. QED 


7.3.9 Minimal excessive function 


Recall Definition 2 in 7.3.1 of the minimal excessive function. We have: 


Theorem 19. The general form of the y-integrable minimal excessive function 
is CK(-,é), €€E, UB, where C is a constant. 


Proof. It can be seen from (68) that Hp, 4, = Hp, + Ha, Suppose CeE,UB and 
K(-,é)=h, + h, and furthermore both h, and h, are excessive functions. Then 


My. +m = Mel's 6) = Ôe Accordingly, ` 
Hy (E* 一 Š) + HA(E* — ¢) = df E* — č) = 0 
and it follows that 
My, (E* — €) = O(e = 1, 2) 


According to the spectral representation (68) of h,, 
hdi) = | K(i, uy, (do) 
E* 


= K(i, čun, (E) = C.K (i, č) 


where C,=y,,(€) is a constant. Therefore K(-,é) (čeEou B) is a minimal 
excessive function. 

Secondly, suppose k is a y-integrable minimal excessive function, and let yp, 
be its spectral measure. Also we may as well suppose h #0. By (58) and the 
corollary to Theorem 3, (Eo O B) > 0. Hence there exists če Eou B such that 
Hs has a positive measure in any neighbourhood of ¢. Let U,={¢:d(¢, č) < 1/n}, 
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h, = fu, KC. Ou, dt. Then both h, and 
h— h,= | K(-, Cudi) 
(EqvB)~ Un 


are excessive functions. Owing to the minimality of h, h, = C,h(C, is a constant), 
so that 
3 yih,() = C, 2 vihi) 
Again on account of the uniqueness of the representation of h,, we get 
Hnn(T) = HUn OT) 
Considering (58), 
HUn) = byl E*) = È vib) 


HE = 2 Ali) 


Thus 
Ha(E*) np 
h=: =—— | K(i, f)ea(50) 
MUD Jv. i 
Letting n > œ we obtain h; = CK(i, č), where C = :,(E*). The proof is terminated. 


QED 
Theorem 20. The essential Martin boundary B is 


B= | ESSE, K(-,€) is a minimal harmonic function, È y;K(i, č) = i (84) 


Proof. Write the set on the right-hand side of (84) as C. By Theorems 15 and 
19, B c C. Suppose eC. Then h = K(-, č) is y-integrable. Write u, for its spectral 
measure. Evidently h has the representation 


h; = | K(i, 6)6(d¢) 
EouB 


By the uniqueness theorem, Theorem 18, p, = ôa that is čeB, C c B. The 
proof is concluded. QED 


7.3.10 Ultimate field and ultimate random variables 


The infinite-dimensional function f (jo, Jis j2.---)(j,E£,& = 9, 1, 2,...) is said to be 
invariant if for any eE, k=0,1,2,..., f(jo dis jas.) =f Ut. jj3,...) holds. 
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Definition 8. A function ® defined on Q, is called an ultimate random variable 
of the chain if there exists an invariant function f such that 


Pw) = f {x,(), x, , (),..-} WEN, 


holds for n = 0 and therefore for all n > 0. We define an ultimate random variable 
® to take the value 0 on Q; =Q — Q. We call the set Ac Q, an ultimate set 
if the indicator 7, is an ultimate random variable. The Borel field on Q. 
composed of ultimate sets is denoted by 2 and is called the ultimate field. 


Suppose A,, AEF. If P (A; — Az) +(A,—A,)} =0, then we write A; ~ Ay. 
If®, and ®, are random variables and P,(®, 4 ®,) = 0, then we write D, ~ ®,. 


Theorem 21. There exists a one-to-one correspondence between the non-null 
ultimate set and the almost closed set A (modulo transient sets) Ander the 
following condition: 


Ax P(A) (85) 
A can be taken as 4 = {i:P,(A) >}, 0<e<1. 


Proof. See Chung (1967, 1.17, Theorem 1) QED 


Theorem 22. There exists a one-to-one correspondence between the non- 
negative bounded P-harmonic function u and the non-negative bounded 
ultimate random variable ® under the following condition: 


u; = E® ® = lim u(x,) (86) 


Proof. See Chung (1967, 1.17, Theorem 5). : QED 


Definition 9. The non-null ultimate set Ac@,, is said to be atomic if A cannot 
be decomposed into the union of two non-null ultimate sets; the non-null 
ultimate set AeB, is said to be completely non-atomic if for any A, cA, 
A Ep, then A, is not atomic. 


Theorem 23. Q,, has the following decomposition: 


Q, = Ao +( U A) (87) 


ae. 


where Aj is a completely non-atomic ultimate set and can be dropped. .o is 
an empty set or a finite set or a denumerabie infinite set, and moreover Ogs. 
Also, A, (a€.%) is an atomic ultimate set. The decomposition is unique. 
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Proof. Making use of Theorem 2.3 and Theorem 5.6, which is to be proved 
latter, we obtain the proof of this theorem. QED 


7.3.11 Martin entrance boundary 


The Martin boundary discussed previously is actually the Martin exit boundary, 
that is, to depict how the process ‘goes to infinity’ from a finite state. As for 
the description of how the process comes to a finite state from infinity, we need 
the Martin entrance boundary. 

Suppose the decomposition of the state space E for the Markov chain P = 
(pi; i, JE) is (2.15) and Eo is the set of non-recurrent states, we write 


Eoo = {i:i€ Eo, there exists jeE — Eo such that i= j} 
E, =E— Ego P= (Pip L JEE) 


Zhen-ting Hou (1974, Chapter 8) points out: any finite excessive measure (a,, 
JEE) of P must be zero on Ego, that is, 2; = 0( je Eoo), and moreover, there exist 
excessive measures that are positive on E,. We fix such a P-excessive measure 
(a; JEE), then the measure (V; je E) is a finite excessive (finite harmonic) measure 
of P if and only if V;=0 (jeEoo) and (V;/x;, jE E,) is the finite excessive (finite 
harmonic) function of P. Here 
P = (pj, i, JEE,) Pij = op/ 

Select a standard measure of P. According to 7 and P, we can well define the 
Martin boundary dE, of P, the essential Martin boundary B, the atomic 
boundary B, and the non-atomic boundary B,. We call @E,, B, B, and B, 
respectively the Martin entrance boundary of P, the essential Martin entrance 


boundary, the atomic entrance boundary and the non-atomic entrance 
boundary. Of course the boundaries mentioned above are relative to &« and 7. 


~ Therefore the study of the entrance boundary and excessive measure can be 


obtained with the help of the study of the exit boundary and excessive function. 
We are not going to discuss it in detail. 


7.4 PROBABILITY REPRESENTATION OF A STOPPING POTENTIAL 


Definition 1. We call a non-negative (including + œ) function u the potential 
of the chain P if there exists a non-negative function v such that 


that is, 
ui = > Gi, jv; ieE (1) 
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The non-zero potential u is said to be minimal if, when u =u? + u?, where 
u! and u? are potentials, then u = u" (a = 1,2,), where c* is a constant. 

If u= Gr, then 


Pu = PGv = (G — Iv =u — v 


Hence if u; < œ, then v; = u; — (Pu); is uniquely determined by u. 


Definition 2. We call u the stopping potential of P if u = Gv, and furthermore 
v; = 0 (ieE — H), where H is the stopping state set. 


Theorem I. wis a stopping potential of P if and only if there exists a non-negative 
function f, (ae H) such that 


u= E; {Jag b < 0} = > fo ieE (2) 
acH 
where 
ul = Pi{xg = a} = G(i,a)d, acH l (3) 


is a minimal potential whereas d, is the stopping quantity of the state a. 
If u is finite then there exists a one-to-to correspondence between u and f, 
and moreover f, {ae H) is also finite 


Proof. Sufficiency: By (3.77), 


Hi = Et Saas B < co} 
= Ed fgy B< œ, x(B)e H} 


T > E;{ feim B=n,x(neH} 
n=0 


=¥ F pias, 


n=0 acH 


= ¥ Gli, adaf, (4) 


aeH 


Hence the u determined by (2}is a stopping potential. In particular, (3) is valid. 
Now we are going to prove that u° is a minimal potential. Suppose 
u“ =u; +t, u, = Gv, (b= 1,2) 


are potentials. Then 


d,Oq(i) = (u° — pu”); = 2, (uy — pus); = v(i) + v2(0) 


"Mis 
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Thereby we obtain v, =c"(d,6,)(b = 1,2, 20 are constants); consequently 
us = cu" (b = 1,2). 

Necessity: Suppose u = Gv is a stopping potential. Take f, = v,/d,(aeH). By 
(4) we know that (2) holds. 

The one-to-one correspondence follows from the paragraph preceding 
Definition 2. The proof is terminated. QED 


7.5 SOJOURN SOLUTION, ULTIMATE SET, ALMOST 
CLOSED SET AND BOUNDARY 


Theorem 1. The (non-negative) bounded harmonic function h corresponds 
one-to-one to the non-negative bounded Borel function f on B according to 
the following relation: 


hi -Í K(i, OSF(ulde) (1) 
B 


lim h(x,,) m f (x) Ei f(x.) S hi (2) 


nw ob 


where the measure is the distribution of the ultimate state, determined by (3.34). 


Proof. According to Theorem 3.18, the function h defined by (1) is bounded 
and harmonic. Conversely, suppose h is a bounded harmonic function. We shall 
assume its bound to be 1. Then both h and g=1—h are excessive. By 
Theorem 3.18, us(E0) = 0, and moreover 


i= | K(i, eju(de) = | K (i, Cyt, + Hg)(de) 
EovB Eo uB 


Therefore p = H, + H, and p, has a density function f bounded by 1 relative 
to u = (dd) = f(S)u(dé). Hence (3.83) becomes (1). 
Rewrite (1) as h; = Ei{ f (x4), Qa }. Consequently the formula (2) follows from 


` Theorem 3.22. The proof is completed. QED 


Theorem 2. Write Ba) for the Borel field on Q,, produced by sets {x(co)eF} 
(Borel sets I< B), then Zo = 多。 
Proof. Since the non-negative bounded 2 „y measurable function ® can be 
written in the form f(x,,), where f is a non-negative bounded Borel function 
on B, it follows that by (2) we know ®= f(x,,) is @,,-measurabie. That is, 
Bes Gwe: 

Suppose that 中 is a non-negative bounded Æ -measurable function. 
According to Theorem 3.22, h; = E;® is bounded harmonic and P=lim __h 


na x(n): 
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By Theorem 1, there exists a bounded Borel-measurable function f on B such 
that (2) holds. As a result, B= f(x}. Consequently ® ts Z ,„ y measurable, that 
is, Za cB and the proof is completed. QED 


xja)’ 


Theorem 3. For any almost closed set A, there exists a Borel set l c B such that 
L(A) = {x eT (3) 


Apart from y-null sets, T is uniquely defined. 


Proof. As #(A)e@,,, making use of Theorem 2 we can prove the theorem. 
QED 


Definition 1. Cali non-zero ue.#*(1) a sojourn solution, if for any ve.# *{1): 
v <u, p Sū—u we have v=0. Here 


i, = P(Q,,) = P( L(E))e.M + (1) (4) 


Theorem 4. There exists a one-to-one correspondence between sojourn 
solutions u and the closed sets A (modulo transient sets} under the following 
condition: 


u; = Pi{ P(A)} (5) 


Proof. Suppose that u is a sojourn solution so that u is harmonic; according 
to Theorem 3.22, there exists a non-zero ultimate random variable 9:0 < ® < | 
such that u; = E,®. Evidently 


vy = min {®, (1 = D)I a< iss 


is an ultimate random variable. Hence v; = Epe H (1), v<u,v<u—u. So 
v =0, and therefore y =0. From this we obtain 中 一 To-1 Because (® = 1} is 
a non-negative ultimate set, according to Theorem 3.21, there exists an almost 
closed set A such that (® = 1) ~ L(A). Thus 


u; = ED = Eil o- = Eil ga = PALCA)) 


Now suppose that u is defined by (5) and assume ve *(1),0< u,v SŪ — u. 
According to Theorems 3.21 and 3.22, Mii 


Í pe-a = lim Uin) Í pe-a) = lim (xen) =< Un) 
nop nao 


and there exists an ultimate random variable ®:0 < ® < 1, such that 


Di 一 三 ;中 ® = lim v 


n> 


x(n) 


Since v < min(u, # — u), it follows that ® < min{f piap l g-a) = 9: 


Accordingly v; = E;® = 0, and the proof is concluded. QED 
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Theorem 5, The sojourn solution u, the non-null ultimate set A, the almost 
closed set A (modulo transient sets) and the -non-null Borel set T {c B modulo 
u-null sets) are one-to-one correspondent under the following condition: 


u; = P{#{A)) Ax L(A) = {x eT! {6) 
Proof. It suffices to summarize Theorems 3 and 4 and Theorem 3.21. QED 


Definition 2. We say a sojourn solution u is minimal if u as a harmonic function 
is minimal; a sojourn solution u is said to be completely non-minimal if for any 
sojourn solution v < u,v is not minimal. 


Evidently, if the completely non-atomic A, appears in the Biackwell 
decomposition, then u? = P(£(A0)) is the greatest completely non-minimal 
sojourn solution. 

As a special case of Theorem 5, we have the following theorem. 


Theorem 6. The completely non-minimal sojourn solution u(<u°) and the 
completely non-atomic ultimate set A{c Ag, see (3.87)), the completely non- 
atomic almost closed set A (< Ay, Modulo transient sets) and the -non-null 
Borel set I (c B,, modulo y-null sets) are one-to-one correspondent according 
to (6). And, the minimal sojourn solution u, the atomic ultimate set A, the 
atomic almost closed set A (modulo transient sets) and the atomic boundary 
point če B, are one-to-one correspondent according to the following relation: 


Ax LA) = {xs =Ë} u; = Pi{.2(4)} (7) 
Theorem 7. The bounded harmonic function u, the non-negative bounded 
ultimate random variable ® and the non-negative bounded Borel function f 
(defined on B, apart from the difference of the function values on j-null sets) 
are one-to-one correspondent according to the following relation: 


u; = ED ® ~ lim xn f(x,)=® (8) 


_ Proof. Summing up Theorem 3.22 and Theorem 1, the conclusions of this 


theorem follow. QED 


. 7.6 CANONICAL PROCESS 
Suppose that E has a discrete topology. Compactifying the denumerable set E 
by one point ‘oo’ (œ ¢E), we get E = EU {oo}. Assume ø to be a non-negative 
(including œ) random variable defined on the complete probability space 
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(Q, F, P} and call X() = {x,(w), t < o(w)}" (os a homogeneous Markov 
process, or simply process, if for any weQ and t < o(w) we have x{t,w)eE, but 


P{x(t)= 0c} =0 t20 (1) 


While for any (22,0 8&t <t < < thy pipiz-- ,ittELb, provided that 
P{ x(t} = ia 1 <a <l} > 0, we have 


PUX(ty 41) = ia 1 |X(t.) = ia 1 <a<l} = Pix(tis 1) = i411 x(t) =i} (2) 


And moreover the value of the right-hand side of the formula above is 
independent of t, and only depends on t+; — t, We call 


p(t) = P{x(s + t) =j|x(s) =i} . (3) 


the transition probability of the process, whose transition probability matrix 
P(t) = {p;(t)} must satisfy conditions (2.2.4) and (2.2.B) and is supposed to 
satisfy (2.2.C) (see section 2.2). According to the notation of section 2.1, that is, 
P(t}eF. If two processes X and X have the same transition probability matrix 
P(t), we say that X and X are the same process. 

Conversely, for every P(t)eF, there exists a process X = {x{t),t < o} with P(t) 
as its transition probability matrix. According to Zi-kun Wang and Xiang-qun 
Yang (1988) we can also suppose X is well separable, Borel-measurable, and 
right-lower semicontinuous. That is, for every weQ. 

lim x(s, œ) = x(t, EE for all t < o(w) (4) 
Slt 
Such a process is said to be a canonical one. If for process X, {4) is valid for 
almost all weQ, and for exceptional œ, x(w) may even have no definition. In 
this case for the exceptional œw, we can revise or add to the definition as follows: 


x(t, w) = EE t<o(w) (5} 


Denote the class composed of all canonical processes X by #. Evidently, # 
is One-to-one corresponding to ¥. According to the notation in section 2.1, the 
class composed of processes Xe X corresponding to P(t)eY, is denoted by #,. 
The class composed of processes Xe corresponding to P(t)e F ,(Q) is denoted 
by #(Q) and X in % (0) is known as a Q process. 

When P(o = «)= 1 {ie £), the process X is said to be honest. If and only if 
condition (2.2.D) is valid, X is honest. 

For a stopping process X = {x(t),t<o}, we can select A¢E arbitrarily, and 
then let | 


et) = w ift<o . 6) 


A ift>o 


1Take x(w) = x(t, œ) and we frequently omit w. 
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Then X = {X(0),t< oo} is an honest process, whose transition probability matrix 
P(t)= {Pult} Gj jEEVU{AS) is well defined by (2.2.3). 
Let Xe. Write Z? for the Borel field generated by the sets 
{x(s) =i} (s <t, ie £). Write 
Fro=(\F; 


s>t 
Theorem I. 


F’ 


— gO 
07, 


The proof is seen in Chung (1967, H.8, Theorem 1). 


We cali non-negative random variable 8 a Markov time for the process X, 
if $ <o, and for any t > 0, 


(B<t<o)eF? (7) 
or equivalently, 

(B<t<o)eF? (8) 
For a Markov time £, let F, be the class of sets A that satisfy A c Q, = (£ <a) 
and AN(B <t<o)eF),t > 0; F p is called the pre-f field. Let F, be the Borel 


field on Q; generated by the sets {x(f + t) = i} (ic E, t > 0), it is called the post-f 
field. 

For the Markov time $ of X, we can define a set translation operator 8 
from F° to F? such that the operations union, intersection and complement 
are invariant under action of the operator Og; for instance, 0,(AU B)= 
(0,4) (8B) and so on. Moreover 


Og{x(t) =i} = {x(B +) = i} (9) 


Hence for a F? -measurable function č, we can define a function O50: (8g¢)(w) = a 
if web; (¢ = a), especially 


@x()=x(B+t) (>0 (10) 
The details are found in Dynkin (1963, pp. 121-44). 
Theorem 2. Xe has the strong Markov property, that is, it possesses the 
following property. For any Markov time £f, provided P(Q,) > 0, 
(i) suppose MeF’, AEF p, then 
P{@,M|A, x(B) = i} = P;{M} icE (11) 
P{x(B + t)= co} =0 t>0 (12) 


(ii) (X(B + 1),0<t<o—} is an open Markov chain on (Qg, QZ, POR) 
whose transition probability is (p,,(2)). 
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(iii) Let A ={x(B)# œ}, o =o —B,x(t)=x(B +t). Then X(w)={x'(t,w),t< 
o'(w)(weA) is a canonical process defined on the probability space 
(A’, AF, P(-|A); the state space E’ of X’ is included in E, and its transition 
probability matrix is the restriction to E’ x E' of the transition probability 
matrix of X. 


We call X’ the post-f process. 


The proof is seen in Zi-kun Wang and Xiang-qun Yang (1988, section 3.3) 
or Chung (1967, 11.9). 


Theorem 3. Suppose that Xe and that $ is a Markov time of X, and assume 
that « is a Markov time of the post-f process X’, then £ + « is a Markov time 
of X. 


The proof is encountered in Chung (1967, 11.15, Theorem 1). 


7.7 PROBABILISTIC Q PROCESS 


The probabilistic Q process Xe (Q) and the analytical Q process P(t)eP,(Q) 
are identical. We say that a Q process X satisfies the Kolmogorov equations: 
certainly by saying so we mean that P(t)e? (Q) corresponding to X satisfies 
the system of Kolomogorov equations, and so on. 

For a Q process Xe (Q), the right-lower semicontinuity property (6.4) 
becomes right-continuity in E: 


lim x(s, w) = x(t, weE for all t < a(w) (1) 
s{i 


If Q process XE H,(Q) satisfies the stronger condition: 


lim x(s, œ) = x(t, we E for all t < a{w) (2) 
slt 


then we call X the D-type process. The class composed of the D-type processes 
is written as X'p. When Q is fixed, the class composed of the D-type Q processes 
X is written as # p(Q). 


Definition 1. Suppose Xe, qi< œ. We call [a,b) an i-interval of X{q), if 
x(t,@) =i for ail te[a, b), but x{t,w) Æi in any interval fc,d) containing [a, b) 
as a proper subset. When i is used in general an i-interval is called a constancy 
interval. 


Theorem 1. Suppose Xew,q;< œ. Then for almost all weQ, X(w) has only 
finitely many i-intervals in any finite interval. 
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The proof is seen in Zi-kun Wang and Xiang-qun Yang (1988. section 3.1, 
Theorem 2) or Chung (1967, II.5, Theorem 7). 
Let Xe (Q). We call 


Se ene 6) 
À a if the set above is empty 
the first discontinuity of X. 
Theorem 2. Let X€5,(Q)}. Then 
Pi{t >t}=e (4) 

when q; > 0, 

P,{x(t,) =j} = M; JEE (5) 

j 


where IT = (T,;) is determined by (2.9.7). 


For the proof see Zi-kun Wang and Xiang-qun Yang (1988, section 2.2, 
Theorems 5 and 6). 


Theorem 3. Suppose that XE#,0<q;< 00,8 is a Markov time of X, 
P{x(B) #i} =0,a is the first discontinuity after $, and let p =a — $. Then for 
AEF p MEF,» 

P{A, p >t, M} = P{A}e ~ P{M |Q,} 


In particular, F, and F‘ are conditionally independent with regard to Qg. 
More particularly, x(t,) and t, are conditionally independent with respect to 
the measure P,. 


The proof is to be seen in Zi-kun Wang and Xiang-qun Yang (1988, 
section 3.2, corollary 2 to Theorem 1 or Chung (1967, II.15, Theorem 2). 
Suppose Xe X (Q). We call 
aA 7) 
HEN g if the set above is empty 


the first time of returning to i after first discontinuity. If P;{n* <a} = 1, we say 
that i is recurrent. If i is recurrent, and moreover 


mi = Emy < 00 (8) 


then we say i is ergodic. If all i are recurrent or ergodic, then we say process 
X is recurrent or ergodic. 
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Theorem 4. 


(i) i is recurrent iff for almost all we{x(0)=i}, X(w) has infinitely many 
i-intervals, or equivalently 


| | pilt}dt = oo 

0 

(ii) Suppose i is recurrent, then P;{a = œ} = 1, and i is ergodic iff 
7+ a0 


If i is ergodic, C is the irreducible recurrent class including i, then 


1 
lim p;(t) = — jeC (10) 


(一 op iMi 


The proof is found in Zi-kun Wang and Xiang-qun Yang (1988, section 4.2, 
Theorem 1) or Chung (1967, 11. t0, Theorem 4 and its corollary in H. 12 formula 
(9)). 


7.8 PROBABILISTIC MINIMAL PROCESS 


Definition 1. Suppose Xe X.. We call te(0, o(w}] a jumping point of X(%), if 
t = o(w) < oo and there exist ieE and e >Q such that x(u, œw) = i for ue(t — g, t) 
or t < o(w)} and there exist different i je E and e > 0 such that we have x(u, w) = i 
for uelt — e,t), and x(u, w) =j for uelt,t + £}. We call te(0, o(w)] a leaping point 
of X(c), if t = a(w) < œ, or t < o(w) and for any ¢ > 0, X (œw) has infinitely many 
jumping points in (t— € t+ £). We agree that t=0 is a jumping point and 
leaping point; it is called the zeroth jumping point and the zeroth leaping point. 


Every Q process Xe (Q) has first leaping point t: 
vo < t < ofw), lim x({s,@) = œ} 
T= 


s>t 


(1) 


o(w) if the set above is empty 


The first discontinuity t, of X may not necessarily be a jumping point. But 
when Q is conservative, t, is a jumping point. If t, { < ø) is not a jumping point, 
according to Theorem 7.2, then 1, is the first leaping point. 
Theorem Í. Suppose Xe X (0), q; > 0. Then 

Pi{t, =t} = di/q; (2) 


where d is the non-conservative quantity of Q, determined by (2.2.6). 
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- Proof. By (7.6) 


=1-}),=- QED 


Theorem 2. Suppose X eX (Q), the set A and the non-negative random variable 
< are all F? -measurable. 
(i) If 


P{A=0, A} =P{é=1, + 6,,E} =1 (3) 


then u; = E,{é, A} satisfies the equation 


2 dui = — Pi{A} (4) 
and u,(4) = E,{e7 * A}(A > 0) satisfies the equation 
的 (5) 
(ii) If 
Pie th} = Pit =r} (6) 
Pift <1,0,,A} = Pi{t <T, A} (7) 


then u; = P,{A} satisfies the equation 
2 diji; =d; (8) 
J 


Proof. It is trivial when q; = 0. Suppose q; > 0. 
By the strong Markov property, Theorem 7.2 and the independence between 
t; and x(t,)}, 


E{C, A} = Ej{t, + 0. 6, 0. A} 
一 > M jE {t Ry a, 6 8,,A|x(t,) =j} 
j 


= x MCE: {t1 0, A| x(t) = j} + E;{6,,¢, 8. A|x(t,) =j}] 
j 


=J IE {ts} P {A} + Ej{é, A}) 


= 5 PAA} + EEA) 
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So we get (4). Secondly 
E{e~*, A} =), Eje77"0,,e° 7, 0,, Alx(t,) j} 
j : 
= » IT, ;E;{e7 411 x(t) = jJE,{0,,e7%8, 0,,A|x(t,) =j} 
J 


= DME fe }E fe“, A} 


Ee A 


{5) follows. Thirdly, 
Pi{A = P {At =7t,} + P0 A, 71 <t} 
RENEE Sues A A} 


Noting (2), we obtain (8). The proof is completed. QED 


Theorem 3. Suppose X €#,({Q). X satisfies the backward equations iff for almost 
all weQ, X(w) the first discontinuity is a jumping point. X satisfies the forward 
equations iff for arbitrarily given t > 0, for almost all we(t < a), X (œ) has a last 
discontinuity in [0,2] and moreover, it is a jumping point. 


For the proof see Zi-kun Wang and Xiang-qun Yang (1988, section 2.3, 
Theorems 1 and 2). 


Theorem 4. Suppose Xe#,(Q),t is the first leaping point, then X¥ = 
{x(t),t < tye (Q), whose transition probability matrix is the minimal solution 
S(t) = {fi(t)} in section 2.9. 


The proof is in Zi-kun Wang and Xiang-qun Yang (1988, section 2.3, 
Theorem 5). 


Definition 2. We cali X = {x(t),t<o}e2#,(Q) the minimal Q process, if 
P{t=o} =1, where z is the first leaping point. 


Suppose Xew (Q), t, is the first discontinuity, ri < +t. If t} = œ, then t= œ, 
and we put t, = œ (n > 1). If t; < œ, then either t} = 1 < œ and in this case 
ta(n > 2) is undefined, or t, <1 and in this case t} is a jumping point. Hence 
after t, there exists a first discontinuity t, < t. If t} = œ, then t = œ, and we 
put t, = œ (n > 2). If t, < œ, then either t, =t < œ and in this case t,(n > 2) 
is undefined, or t, <t, in which case qt, is a jumping point. Therefore after t, 
there exists a first discontinuity t, < t. And it continues like this. 
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Write tg =0,9 =Q UR, 


(2$) 


OS ane 


Ti 7 (9) 
Qo = (\t<t+ |] (n= t= oo) 
n=1 n=1 
a ifwen, (10) 
sup{nin>0,t, <7} fwe, 
Tp = limt, (11) 


php 
Then on Qp we have t, <1, on Q, we have t, = 7. 

When t, = 00, we set x(t,) = le where K = max {m:t, < oc}. Thus, when 
ns B, that iS Ta < Tg, X(t,) is well defined. 

By the strong Markov property and Theorem 7.2 we obtain the following. 


Theorem 5. Xr= {X(t), n <8) or write X-={X(t,).t, ST} is a Markov 
chain. Its one-step transition probability matrix I = (Hi)is defined by (2.9.7). 

We call the Markov chain Xz the embedded chain of the process {X (t), t < Tt}, 
and call the matrix [1 the embedding matrix of the matrix Q. 


7.9 RESOLVENT PROCESS AND INDUCED PROCESS 


Suppose X = {x(t),t<a}eH#, and p is a random variable independent of X, 
its distribution being the exponential distribution with parameter 1: 


P{p>t}=e"' 120 (1) 
For 4 > 0 let 
A= p/h g? = min (G, p° 
RRP (0, p°) 2) 
x*(t) = x{t) t<o" 


Theorem 1. The process X* = {x*(t),t <o*}e#. Has transition probabilities 
pit) =e "pit) (3} 
where p;;(t) are the transition probabilities of X. 


Proof. Since the path of X+ is the front section of the path of X, we need only 
prove the homogeneous Markov property of X*. 
Suppose 0<t, <t,<-+<t,4,,1,,42,-...4,4,€E. By the homogeneous 
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Markov property of X and the independence between p and X. 


Pix’) = is |<agn+1}=P {Xll} = in lgagntl,tr <p?) 


n 
= Pi x(t) oP aiana ( fo+l — taje Nn! 

= P{x(t,)=i,}P {t, <p* TT ph. .t +1 — te) 
= P{xXt,)= J TT p | tarı — ta) QED 


We call X^ the resolvent process of X. 


Theorem 2. Suppose that X = {x{t),t <rt} is the minimal Q process, I is the 


embedding matrix. Then the resolvent process X* is the minimal Q% process, 
where 
gi = Gili +j) q =4+q; (4) 


The embedding matrix M(A) is determined by (2.9.8). 


Proof. It suffices to show that Q* has the same form as (4), the rest being 
obvious. Suppose that t? is the first discontinuity of X+, then t? = min (t1, p+), so 


exp(—qit)= Pift >t} =P,{t, >t, p>1) 
= Pi{t) >t}P{p*>t}=e We * sexp[—(A+q)t] 


so that 4? = À + q;. Secondly, for j i, 


4 
qi; f . 
D = Pi pė) =j} = Pi{x(t) =), t < pt} 
=P, {x(t =j P{t, <p y= My 
hence qi t = qi; ij and the proof is completed. QED 


Theorem 3. Suppose X = {x(t), t <1} is the minimal Q process, A is the ultimate 
set of the embedding chain Xy, P(A) > 0. Then the process X“(w) = {x(t,w),t < 
t(w)} (weA) confined to A is the minimal Q? process on the probability space 
(A, AF, P{-{A}), and its state space is 


= {i|P,(A) > 0} (5) 
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Its transition probability is 


fi (OPA) 
PA) aI 6) 
HO PAA) 
The Q matrix Q^ = (qf) (i, jeE’) is conservative, and furthermore 
a PAN) (7) 
” PA) 


Proof. First notice: for any t > 0, we have A =6@,A on (t <t) where 0, is the 
translation operator. Actually, because A is a ultimate set, there exists an infinite- 
dimensional invariant function g such that 


La = (x(t), X(T. + 1),...) for all a (8) 
So by Dynkin (1963, p. 122), 
loa = g(8,x(t,,), O,x(T + 1), i 
= g(X(0, Ta) X(0, Th + 1)s--- (9) 
On (t<t) there must exist | such that t,<t<t,,,; therefore Dr 一 Tt 
Accordingly by (8) and (9), 
lon 三 g(x{t,, +1), X(T +14 1),.. .) = la 


that is, we have A = @,A on (t <1). 
Suppose 0<t, <h < <ty4ysi,,i2,-.-5i,4,€E*. By the homogeneous 
Markov property of X 
Pixeln) = in A, Xela Sian l asn} 
es x(t,) =i, |<a<nth 
7 P {xla )= iste 1, A} 
~~ PLx(t,)=i,, 1 <a<n,A} 
_ Pixlta) = to Po Cut 
P{x(t = nl<a<n,o, A} 
z TE (tasi í a) Pins fA ) 
P{x(t,)=i,1 Sas n}P, (A) 
= Po (tees z5 t,) 
It remains to be proved that Q? is conservative, and this follows from 


P(A) = P(0,,A = athe i 


The proof is over. QED 
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Corollary 


Suppose that X is the minimal Q process, P(Q) > 0. Then X°% is the minimal 
OF* process on (Q,,,.Q,,F, P(-|Q,,)) and moreover is conservative. 


Definition 1. Call process X the induced process of the minimal Q process on 
the ultimate set A. 


7.10 PROBABILITY REPRESENTATION OF 
THE (A) POTENTIAL 


Suppose that X = {x(t),t<t} is the minimal Q process, H the set of non- 
conservative states of Q, d the non-conservative quantity of Q, and I1(2) the 
embedding chain of the resolvent process X* of X. For convenience, we write 


f= SÀ 


Theorem 1. For the chain I(A), u{2) is the potential of a non-negative function 
r equal to zero on E — H iff u(A) has the representation: 


ulh) = Ei{e “f(x._0), Qe} = [6Adf]; l (1) 
where f{a) >O (ae H). 


Proof. Sufficiency: By (1) 


where 
Ee Ee Pag) T =th=f; = ac di fi 
i O25) te 


“ony a ap nary 
ri 


j å +y; 
T" = TAT"! = = HAA + G) df 
i megar = 
n=1 


So u{A) is the potential of the function v; = d; f;/(4 + q;} while v is zero on E — H. 
Necessity: Take 


(A+ data 


H 
d, (ae H) 


Jis 
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By the proof of the sufficiency, we know u(/) has the representation (1), and 
the proof is terminated. QED 


Theorem 2. Suppose 
GAay= FN") = PAG + q) 
n=O 


and column vector v > 0. Then 


[m4]; = E,fe7**"v(x,,)} (2) 
[Gav], = ¥ Efe *olx,,)} (3) 
n=0 


Proof. Following Theorem 1 we can prove (2), and hence (3) follows. QED 


Corollary 
ij(A) = E,{e"*™, x(t) =j}. 


7.11 入 -IMAGE AND STANDARD IMAGE 


Recall that a harmonic function is non-negative. We write the class of finite 
Il- (or II (2}) harmonic functions as M* (or A +}, denote the class of bounded 
H- (or TI(å)-) harmonic functions by #* (or æ? ), and denote the class of 
TI- {or TI{2)-) harmonic functions having the upper bound K by .#*(K) (or 
ACT (K)). _ 

Suppose ue.# *. Then M(A)ju<TMu=u, I (Mu < Tu <u, so M”(2)u} 
u(A) < u, and moreover u(J)e.4 7. Ifue.@*(K), then (Aje? (K). 


Definition 1. Suppose ued *, Ais fixed. We call u(2) = limpan O (Auek + the 
A-image of u. 


Theorem 1. ue. + and its A-image u(A)e.M 1 have the following relation: 


Ad(Aju =u — ul} (1) 
Proof. Obviously 
》 WAa= } NAL + gq) ‘gll+1 (2) 
a=0 a=0 


Consequently if we let 
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then (2) becomes 

P (AA +4) = bq + 1 

Apr (A) + "+ (Ag = o"(AqH +1 (3) 

Multiplying from the right by u and noticing that Hu = u, we obtain 
Ag’ (Aju + 6" * Aqlu = o"(A)qlu + u 
Ag” * (Aju + AAAI + gq) tgu = u (4) 
49 (Au + 11" * (Au = u 


Setting n— œ we obtain {1). The proof is concluded. QED 


Suppose that u(A) is a T(A)-harminoc function but not necessarily finite. Then 
T]u(A) > W(A)u(A) = u(A), 1"* 'u(å) > Mul). Therefore T"u(A)tu > ul), and 
moreover Flu =u; that is, u is a M(A)-harmonic function, but not necessarily 
finite. 


Definition 2. Let u(A) be a Il(A)-harmonic function. We call the TI-harmonic 
function u=lim,_,, 1"«(A) the standard image of u(A). 


Theorem 2. Assume that u(Aje.# +. Then its standard image is! 


u = u(i) + AT u(A) . (5) 
where 
= lim 由 (4 = 2 m 
ajo 


Proof. Rewrite T(A)u(A) = u(A) as 
u(A) + Aq”) u(A) = Mud) 
Multiplying from the left by TI” and summing over 0 <n <a — 1, we obtain 
a~1l 
u(A)+ 4 > Mq uf) = Muf) 
n=O 


Letting n> œ, (5) follows, and the proof is completed. QED 


Remark 


From (5) it can be seen that the standard image of the harmonic exit family 
u(A} (A> 0) agrees with Definition 2.10.2. But the 4 in Definition 2 may be a 
fixed non-negative number. 


t When q; = 0. set liq; = X. But from IM(Aju(4) = uN) we know u (4) = 0, and q; hence (1/q,)u,(A) = æ% 
0=0. 
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Theorem 3. Suppose u(A\e M >. The standard image of u(/) is ue 4*, Then 
(1) is true. 
Proof. Equation (3) is already known to be true. Multiplying (3) from the right 
by u = u(å) + ATu(NWe A+ we have 
AG" + (Aju + o" (Agu = b"(A}g Mu + u 


Ag”? (Aju + > MAA +a) +a uli) + AT utd] 


=- (AA+ q) ta [u(A) + APA) F u 


Ag"* (Ayu + II+ HA) [ulh + AP u(2)] = u 


. Noticing that u(A)e.@ + 3, that is, 


1b"* (Ayu + uD + 0" * (AAT ulh) = u (6) 
However as ue. +, 


T"**(a)aru(ay < O" + ATu) = "+ [u — uA) ] =u — M+ ulh) Lu- u= 0 


Letting n— œ in {6), (1) follows. The proof is terminated. QED 
Corollary 
Suppose u(/)e.# +, and its standard image isue.# *. Then 
PAu = Tua) (7) 
Proof. The assertion follows from Theorems 2 and 3. QED 
Let 
M * = {uNe M} ithe standard image of u(A) is ue A+} (8) 
NH * = {ue *|uis the standard image of some u(A)e.M +}. (9) 


Theorem 4. Between M + and Æ * we have established a one-to-one corres- 
pondence between the standard image and the 4-image. Furthermore, the 
standard map and the A-map are mutually inverse maps. 


Proof. Clearly, the standard map maps æ + onto NH + by Theorem 3. ned 
standard map is one-to-one. Now we suppose the standard image of u(A)e_M + 

ue. *, and the A-image of u is v(A). By Theorems 1 and 3, v(A) = u(A), which 
means that u(A) is the A-image of u. The proof is finished. QED 
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Theorem 5. Under the standard map or the 4-map, there exists a one-to-one 
correspondence between the I'(4)-minimal u(A)e.# + and the -minimal ue.@ . 


Proof. According to the definition of minimality, and by using Theorem 4, the 
assertion follows. QED 


7.12 > BOUNDARY OF MINIMAL Ọ PROCESS 


Suppose that X= {x(t)¢<t} is the minimal Q process and that 
Xr = {x{t,), n < f} is its embedding chain with its embedding matrix denoted 
by IT. According to section 7.3, for the chain II and X, we can introduce the 
concepts of its Martin boundary @£, essential Martin boundary B, atomic 
boundary B,, non-atomic boundary B,, ultimate Borel field 多 , and so on. We 
still use the notation employed in sections 7.3 to 7.5. But in the present case, 
Q; and Q, in (2.17) should be understood according to (8.9) and (8.10); H 
should be the set of non-conservative states of Q; (3.11) becomes 


x(t — 0) = lim x(t,)EeH UB (1) 


tnft : 
or more precisely, x(t ~ 0)EH on Qp, x(t — 0)eB on Q,; whereas the measure 
H in (3.34) becomes 


AD= P {x(t ~ OEP} TecHUB (2) 


Obviously, K(-, é)e.H + when ¢€B. Suppose the 4-image of K(-, č) is K,(, é). ` 


By Theorem 11.1 we have 
AAKE, č) =KC,č)— K0, č)  čeB (3) 


According to the resolvent equation of ${14), and from the formula above, we 
obtain 


Kal, )— KC, E) + (A — vb(A)K(-, č) =0 (seB, 4, v > 0) (4) 


That is, K ,(-,¢) is a harmonic exit family. Thus either for all A> 0, K,(-,¢) =0 
or #0. And so we can let 


B, = {€eB\K,(-, č) #0} (5) 
B, = {€eB|K,(-,2) =0} | | (6) 


Definition 1. We call B, and B, respectively the Martin exit boundary and the 
passive boundary of the minimal Q process X or of the matrix Q. 


Theorem 1. B, and B, are Borel sets. 


Proof. Since B is a Borel set and moreover K(i, č) (€€B) is a Borel-measurable 
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function for every ieE, it follows that K ,(i, č) (če B) is also a Borel-measurable 
function. Accordingly 


B. = (J (e1K (i, č) #0} 


iek 
is a Borel set, and so is B— B, = B,. The proof is completed. QED 


Theorem 2. Suppose €¢B,, then K(-, čje *, KC, čje 1+. Moreover the 
standard image of K,(-,¢) is K(-, č), and the A-image of K(-, č) is K,(-, č). 


Proof. By (3), KiC č) <KC, č) TW"K,(,.¢)< MKC, €)=K(-, č) So the 
standard image of K,(-,¢) is u = limps a "KiC, E) S KC, é), that is K,(-, Se 
M į, ue M *. According to Theorem 11.4, u= K(-, č). QED 


Corollary 


{u(A)e.# + |u(A) is 11(A)}-minimal, the standard image of u(A) is y-integrable} = 


. {cK,(, i GeB,, constant c > 0}. 


Proof. If follows from Theorem 2 and Theorem 8.19. QED 
For any Borel set I c B, let 
XT = P,{x(t—Q)el} = | K(i, ude) (7) 
工 
Xi (2) =E {e7 * x(t — Oel! (8) 


Theorem 3. For any Borel set T c B, 
iO(A XT = XF — XTA) (9) 


Proof. By the homogeneous Markov property of X and A = {x(t — OjeT } being 
the ultimate set, 


xr0=| e *dP.{[A,1<t} 
0 
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= xag” ec UP{t<1,x(t)=j,0,A} de 
0 


7 . 
Theorem 4. For any Borel set F c B, 


K (i, €)u(de) = X; °A) (10) 


ABe 


Xi A= | K (i, cs}u(de) = | 
r r 
The standard image of XT (4) is X'°8ee.H *. And the A-image of X" is X'(A). 
Proof. By the definition of B,, we have the second equality in (10). Since 
HAX = | IT"(A)K{, Eu(de) 
T 


setting n — o, it follows that the 4-image of X" is fr Ka(, &u(dé). By Theorem 11.1 
and Theorem 3 we obtain the first equality in (10). Hence by (10). 


XT(N) = | II 
Tn Be 


Taking the limit, we know that the standard image of X'(A) is 


Kl, Ejn(de) 


| K(-, €)u(dé) = X107. 
TnBe 


and the proof is completed. QED 


Theorem 5. For all ie E, 
Pi{t < co|x(r —O)EB,} = 1 (11) 
Pi{t= œjx{t —0)eB,} =! (12) 


Proof. By (10) 


XPo(4) = Et{e ~, x(t — 0)EB,} = Efe *, t < œ, x(t — 0)EeB,} 


= | K(i, č)u(dč)=0 
Bp 


ry r a TE nt Et A r: 
peat ll EE 
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From what precedes we get (12). Secondly 
N’ Xi (A) = E{E [le T< 00, x(t — ET }} 

=E{0, [e ^, t < œ, x(t — 0er ]} 

= E; {e74 t < œ, x(t — 0)eT } 
Taking the limit we know that the standard image of XT(2) is 
Pifr< œ, x(t —0)er}. Especially, the standard image of X®?°(2) is P;{t< 
œ, x(t — 0)eB,}. But according to Theorem 4, the standard image of X**(A) is 
X7., And so Pi{t < œ, x(t — 0jeB.} = P;{x(t — 0}E B,}. From this we get (11), 
and the proof is terminated. QED 


Theorem 6. Suppose f isa non-negative Borel function on B,. Then the standard 
image of 


u(A) = Ele 7^ f [xt — oj- | Kli, OF (S) ude) (13) 
Be 


= E,{ f [x(t — 0)], x(t — 0)e B. } = | K(i, eo)f (eu(de) (14) 
Be 


Conversely, if u,<o (ieE) determined by the formula above or f is a 
‘non-negative Borel function on B, and furthermore 


a; = E; {fixa —9)],2,.} = | K(i, č) f (Su(de)} < %. (15) 
then the A-image of u or u is uA). 
Proof. Similar to the proof of Theorem 4. QED 
Theorem 7. (OE), = {n aE } c Bp 


Proof. Fix a jeE,. Suppose the time that the minimal Q process X stays at j 
after reaching j for the nth time is p}. Then pi(n > 1) are mutually independent 
with respect to P;, t>- pj = oo. That is P,{t = œ} = 1. Hence for any i, 
Pi{t = co|x(r —0) = €,} = 1. According to Theorem 5, ¢,€B,. QED 


Theorem 8. For any ieE, 
Pi{t< co|x(t—OjeH} =1 (16) 


Proof. Note that 9j > 0 when jeH, that is, j is non-absorbing. If x(t —0) =j 
and t = oo, then there exists to such that for all t > to we have x(t, œ) =j. Since 
jis non-absorbing, except for the œw sets whose probability is 0, this is impossible. 
The proof is completed. QED 
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Combining Theorems 5 and 8, we have P, almost surely QED 
x(t —0jeH OB, ift< 20 (17) 
x(t — OeB, if t=% (18) 


7.13 PROBABILITY REPRESENTATION OF M; 


Theorem 1. Suppose that f is a non-negative, bounded Borel function on B, u(A) 
is defined by (12.13). Then we have P,-almost surely 


f[x@—-9)] when x(t — 0)e B. 


(1) 
0 when x(t — 0)e B, 


lim u aA) = | 


Proof. Because on 0,, 


uin (å) = E,{9,,(€° “Ff [x(r — 0)],x(r —O0)eB)F,,} 
= Ee m= yl B 0)], x{t = OeBIF,,} 
=e **E {e7 **f [x(t — 0)], x(t — NEB F,,} 
When n-» œ, making use of the convergence theorem for martingales, we get 
lim use l) =e “er “flx(r — Oo orem 


By this formula and using Theorem 12.5 we obtain (1), and the proof is 
concluded. | QED 


Theorem 2. Suppose that for a Borel set T c B,X" is defined by (12.7). Then 
we have P,-almost surely l 


1 if x(t — O)eT 
lim XE,, = | eh (2). 
n> K 0 if x(t —HeB-T 
Proof. This is a special case of Theorem 3.22. QED 


Suppose that f is a bounded Borel function which is zero on B, and is 
non-negative on B,. The class composed of such functions f is written as Fi. 
If fi f,eF t+ and u{ f, # fı} =0, then regard f, and f, as the same function. 


Theorem 3. The element u(å) in H+ has the following general form: 


u(4) = Ete “fLx(t — 0)]} =| KALEME = feF 2. 0B3) 
Be 
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The element u of .#* M.A * has the following general form: 
u; = Ef f(x(t—0)]} = | K (i, &) f (eu(de) JeF: (4) 
Be 


u(Aje. Hi ue M* oM t+, feF] are one-to-one correspondent under the 
following conditions: 


ul)= Efe “f [x(t -0h = Be lim tsa} (5) 
u = E; f [x(t — 0)] = El lim wa | (6) 
SEx —0)] = hm uga (4) = lim te, {7) 


Proof. By Theorem 12.6, if fe¥ 2, then for u(A) and u, determined by (5) and 
(6), uAje. Mt, uc Mt vn. * hold. a 

Suppose u{Aje M}, whose standard image is ue * œM *. According to 
Theorem 5.7, there exists a non-negative bounded Borel function g on B such 
that u,;=E,g[x{t-—0)]. By Theorem 12.6, the A-image of u is ufA)= 
FEife “g[x(t — 0}]}. Taking f =glp, €F 7 we know u(A) has the form (3). 

By Theorem 1 we derive the first formula in (7). Again by (4) and Theorem 5.7 
we obtain f[x(t —0)] =lim,_, ,.u,,,,,, hence we get the second formula in (7). 
The proof is terminated. QED 


7.14 ATOMIC AND NON-ATOMIC EXIT BOUNDARY OF 
THE MINIMAL Q PROCESS 


Definition 1. We call B,, = B.A B, (a = 1,2} the atomic exit boundary and the 
non-atomic exit boundary of the minimal Q process (or matrix Q) respectively. 
Similarly we can define the atomic passive boundary and the non-atomic passive 
boundary. 

Theorem 1. When teB.,, KC, č) is bounded; when €€B,,, KiC, č) is unbounded. 


Proof. By the definition of standard image and j-image and by Theorem 12.2, 
when €€B,, both K(-,¢) and K,(-,é) are bounded, or unbounded. 
Suppose teB.,, then (č) > 0. By (3.40), 
1 > pi(x{t — 0) = ¢) = K (i, én(de) 
K(i, ) < 1/n(Q) < œ 
That is, K(-, č) is bounded. 
Suppose €€B,, K(, č) is bounded. So K(,č)} is the standard image of K,(-, č) 


204 MARTIN BOUNDARY AND Q PROCESSES 


and moreover is a bounded I-harmonic function, that is K(-,o)e.4* 0.4 *. 
According to Theorem 13.3, there exists a non-negative bounded Borel function 
f on B, such that . 


K(,¢) = | K(-.¢) f(Q)u(de) 
Be 


By the uniqueness Theorem 3.18, surely f (Ouid = ô: df, so that f(€)u(¢) = 1. 
But f is bounded, therefore (č) > 0, that is €€B,,. The proof is finished. QED 


Definition 2. We call the elements of .A + the non-negative solutions of the 
equation 


Au— Qu=0 />0 (1) 


Wecallu(Aje. 4 7 the minimal solution or the completely non-minimal solution 
of the equation (1), if u(4) as a F(4)-harmonic function is minimal or completely 
non-minimai. 


Theorem 2. B., = ¢ iff there does not exist any bounded non-negative minimal 
solution to equation(!); B.,=@ iff there does not exist any bounded 
non-negative completely non-minimal solution to equation {1), or equivatently, 
there does not exist a non-negative minimal] solution u(å) to equation (1) such 
that u(A) is unbounded and the standard image of u{2) is y-integrable. 


Proof. It follows from Theorem 1, the corollary to Theorem 12.2 and 
Theorem £3.3. QED 


7.13 EXITING ALMOST CLOSED SET AND THE BLACKWELL 
DECOMPOSITION OF THE MINIMAL QO PROCESS. 


Assume that X is the minimal C process. According to Theorem 5.6, and in 
accordance with the Blackwell decomposition (2.2.19) of the embedding matrix 
Il, the potency of the index set sf is equal to that of the atomic boundary B,, 
so we can assume . = B,. Hence we have 


P(A)= {x(t —0) =a} aeB, (1) 
£(Ao) = {x(t — 0)eB,) | (2) 
Definition 1. Suppose that A is an almost closed set. We say that A is exit if 
P{t<co|Y(A)} =1 (3) 
We say that A is passive if 
P{t = 0|L£(A)} =1 (4) 
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Obviously, if A is an atomic almost closed set, and not exit, then it must be 
passive. But if A is a non-atomic almost closed set, the conclusion above is not 
true. 

As for the completely non-atomic almost closed set Ay, according to 
Theorems 5.6 and 12.5, we can decompose it into Ag = Age U Aop, where both 
Ao, and Ag, are almost closed sets, so that 


L(A) = {x(t — NEB, } = {x(t — 0)EB,,1 < œ} 
L(Aop)= {x(t — OE B,,} = {x(t — 0)EB,, t = oc} 


Accordingly Ao, is exit while Ao, is passive. Thus we follow the Blackwell 
decomposition of the minimal Q process. 


Theorem 1. Suppose that X = {x(t),f<t} is the minimal Q process. Then its 
state space E has the following decomposition: 


E= Ago (J A.) Aap 局 A,) (5) 
ae., acB,, 


where Ay, and Ag, are completely non-atomic almost closed sets, exit and 
passive respectively, and therefore may be not present. A, (aeB.,) are exiting 
atomic almost closed sets while A,(aéB,,) are passive atomic almost closed 
sets. The decomposition is unique modulo transient sets. 


7.16 THE CONDITION FOR FINITE EXIT 


Theorem 1. Suppose that finitely or denumerable infinitely many exit almost 


closed sets A, are mutually disjoint. Write 


X4) = Eile, £(A,)} (1) 
If oles < ©, Toca X(N = 0, then c, =0. 


Proof. By Theorem 5.6, there exist mutually disjoint Borel sets I, such that 
P(A.) = {x(t — O)eT,} and p(T,) > 0. According to Theorem 12.4, the standard 
image of X“(A) is Xf = P;{x(t — O)eT,}. Consequently by Yc, XA) = 0 we get 
VaCaX * = 0. According to Theorem 3.22 y cuvl (x(e- O)er,) = O, that is Facslr, =0 
(u, a.s.). Thus c, = 0. The proof is concluded. QED 


Theorem 2. Suppose a,beB,,. Then 


1 wheni>a 


X70) = Bile x(¢~0)=a} af wheni>b#a 


(2) 


Proof. According to Zi-kun Wang and Xiang-qun Yang (1988, section 0.2, 
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Theorem 4), for any be B,,, the limit lim;_,X7(A) exists, and so we only need 
to calculate the limit, which follows from Theorem 13.2. QED 


Theorem 3. Suppose 0 <n < œ. The following conditions are equivalent 


(i) In the decomposition (15.5), Ay, vanishes, the potency of the set B., is n. 
(ii) The dimension of „æ $ is n. 
(ii) B, is composed of only n atomic boundary points. 


Proof. It is obvious that (i) and (ii) are equivalent. 

()=(ii). Suppose that A,,...,A, are exit atomic. By Theorem 1, 
Xu <a<n) are mutually independent. Secondly, by Theorem 13.3, for 
u{A)je.# 7, there exists f such that 


uf) = Efe [x(t — 0])} = ¥ Efe fixt- 0)], A(A,)} 
=1 


和 f(a)X H(A) 
That is, the dimension of æ$ is n. 

(ti) => (i). First we show P,;{#(Ag,)| = 0(ieE). Otherwise, there exists i such 
that P(Y¥{Apo,.)} > 0. Since Ape is completely non-atomic, it follows that there 
exist infinitely many disjoint almost closed sets. Thereby by Theorem 1, to .#; 
there are more than n linear independent solutions. This is in contradiction 
with (ii). So Ap, vanishes. By the process of proof of (i)=(ii) we know the 
number of exit atoms is identical to the dimension of .#7, and the proof is 
completed. QED 


7.17 A CONDITIONAL INDEPENDENCE THEOREM 


Suppose that X = {x(),t< oye X (Q) is the non-minimal Q process, and that 
x is a Markov time of X,P{x(a) = œ} ee oa, <0. We write the first 
leaping point after x as S Ta; onfa < o), 0,T = Ta; let t= 0,1,. We write F „ for 
the pre-t; field, and Z „ for the minimal Borel fi eld on Q containing all 
F An > 1). i i 


Theorem 1. Suppose Ae. F? „Ae F ,-. There exists a Borel function f which is 
defined on HUB, and is independent of the conditional distribution of X (a), 
relative to (x < g), such that on {x{t, — 0)e HU B,}, P,-almost surely holds 


P{0, AIA,x(t — 0)} = f {x(t —0)} © D 


The condition on the left side of the above formula should be understood as 
la X(t, — 0). 
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In order to prove Theorem 1, we need to quote a theorem in Dynkin (1963, 
p. 782), which is stated as follows. 


Theorem 2. Suppose that (Q, F, P) is a probability space, Elt| < 0, QEF, 
2, JQ (nf co), A, E F.,A, is a Borel field on Q, and moreover .om E A p 
(m <n). Then on we have almost surely 


lim E(E|.,) = E(é|.) 


n> 3 


where .xf is the minimal Borel field on Q including all ./,. 


Proof of Theorem 1. First we prove (1} is almost surely true on 
M ={X(t,—0)eH}. For this, let 


pa. ifweM, t, = 1", 07 <2" 
oO if wo¢M 


Note that when AeZ,-, A(X{(P)=ijeZ pp. What is more, {X(t,—0)=if = 
{X(B) = i}. According to’ Theorem 6.2(i), when X(t, — 0) = ieH, (1) is true, and 
furthermore the restriction of f on H, f(a),aeH, is independent of the 
conditional distribution of X(a), relative to {æ < ø). So (1) is almost everywhere 
true on M. 

Secondly, we verify that (t) is almost surely true on N = {X (t, — 0)EB,}. That 
is, we must prove that 


IyP{@, AJA, X(t, ~ 0} = Inf {X (ta — O}} (2) 


According to the definition of conditional probability, on N we have almost 
surely 


P{0, A, MIA, X(t, —0)} =0 


.that is 


lnP{0. A, M|A, X(t, = 0)} =0 
so that the left side of (2) is equal to 
lnP{0. A, MIA, X(t, —0)} (3) 


Now let Q,=(t2<1,),07,=F wÈ = lyng, Then the conditions in 
Theorem 2 are satisfied. Obviously, N <Q’ = rer Q,; on Q, we have € = 0.an, 
where y = Lig anxie- oes,» And it is easy to see 


u(i)= Ene at 
Thus by the strong Markov property and Theorem 2, on {Y we have almost 
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surely 


E(E|.o/) = lim E(E|.o/,) = lim Ex 


now anv* x 


= lim u{ X(t")} 


Thereby we have 
LyE(Eé|.o) = lim Iyu{X(22)} 


noo 
We can easily see that @ = lim, . „ 1yu{X(t%)} is a non-negative ultimate random 
variable; so there exists a non-negative Borel-measurable function f on B such 
that $ = f {x(t, — 0)} = Inf {x(t — O)}. 


Consequently 
LyE(E| 0) = I yf (x(t. — O)§ 


Because AEF,- c A, X(T, — 0) is «-measurable, and hence the left side of 
(2), that is, expression (3), equals 


IyE{E|A, x(t, — 0)} = LyE{E(E| A), x(t, —9)} 
= E{1yE(E|.x/)|A, x(t, — 9)} 
= E{tyf{x(t, — OJIA, x(t, — 9)} 
= lyf {x(t, E 0)} 


Thus we have proved (2). 

We are going to prove that the restriction of f to B., f(a), ae B., is independent 
of the conditional distribution of x(a) with respect to (a < a), but we should 
think of the function and a function which is equal to f y-almost surely as the 
same function, u being the ultimate state distribution. For this, it suffices to 
apply the following fact: Suppose (x,) is a Markov chain, and u(i) (ie E} is a 
real-valued function. If for any initial distribution, with probability 1 limit, the 
lim, , u(x»), exists, then this limit is independent of the initial distribution. In 
the foregoing fact, taking the Markov chain x, = x(t*) defined on the probability 
space ((a <0), (a < ao)F,P( |œ < 0)) we get what we intend to prove. 

The proof of the above fact is as follows. Suppose the ‘distribution v = v(i) 
satisfies v; > 0, for all i. By P,(u(x,}— A(v)) = 1 we derive P{u(x,)— A(v)) = 1 
for ali i. On the other hand under the supposition that P,{u({x,)— A(d;)} = I, 6; 
represents the unit distribution concentrated at i. So P,(A(v) = A(6;)} = 1. Now 
suppose v’ is any distribution. When v; > 0, repeating the argument above we 
obtain 


P{A(v) = A(d,) = A(v')) = 1 P{A(v) = A’) = 1 
Thus we have P,,(A(v) = A(v’)) = t. By symmetry, P,(A(v) = A(v’)) = 1. If $ is 


PE a 
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another distribution, from the above P,(A({v) = A(8)) = 1. It follows that 
P (Av) = A(d)) = 1 P{A(v') = A(d)) = 1 (for all i) 
P (A(x) = Ae) = 1 


According to Theorem 5.7, there exist non-negative Borel functions f,. and 
fz, such that Afv’) = SAX), AÒ) = fa{x..). Therefore P (foxo) = faxa) = 1. 
That is, f, = f; is true -almost surely. The proof is over. QED 


Corollary 


Suppose Ac¥,-,AeF%, then under {t<o0,x(t—0)}, A and 6,A are 
conditionally independent. That is, on {x(t —0)€H UB,}, almost surely holds 


P{A0,A|x{t — O}} = P{A| x(t — 0) P{6_A|x(t — 0)} (4) 


7.18 FURTHER DESCRIPTION OF GENERAL Q PROCESSES 


Suppose that X = {x(t),t<a}e#,(Q) is a non-minimal Q process and its 
resolvent operator is w(A). 


Theorem 1. (A) has the following representation: 


yd = G+ 2 xara | X (A, dg )F (4, a) (1) 
Bez 


acH Be; 

where 
X4(A) = Efe *, x(t — 0) = a} = ¢,,(Ad, acH (2) 
XA) = Efe, x(t — 0) = a} deB, (3) 
Xi, T) = Efe" *, x(t — 0er} TcB., (4) 

and 

l F%A)>0 ALF%(4), 1] < 1 acH oB. (5) 
F(A, a} > 0 ALF{A, a), 1] <1 for z-almost all aeB,, (6) 

_ Proof. 


Wi(4) = E; [exe dt 
0 


= B | ul dt+ gf er-ad [x()] dt 
0 T 
= $;(4) + Be [euman xa 


T 


210 MARTIN BOUNDARY AND Q PROCESSES 


By the corollary to Theorem 17.1, the second term of the above formula is equal 


to 
efeint f eoa 


= | Efe~*, x(t — Deda E 0, | eM Ext dt|x(t — 0) = a} 
HOB, 


0 
= | X fA, da)F (A, a} 
HUB. 


Parts (1), (5) and (6) follow from this. As for the second equality in (2), it is 
derived from Theorem 10.1, and the proof is concluded. QED 


7.19 INSTANTANEOUS RETURN PROCESS AND 
ITS BOUNDARY 


Recall the class # p of D-type processes, defined in section 7.7, and the definition 
8.1 of the jumping and leaping points. Declare the minimal process to be a 
zero-order instantaneous return process. 


Definition 1. Suppose X = {x(t),t<a}€Hp is a non-minimal process. If for 
almost all œ and any t < a(w), X(w) has at most only finitely many leaping 
points in [0,7), then we call X a first-order instantaneous return process, or 
simply a first-order process. The class composed of first-order processes (or 
first-order Q processes) is written as % | (or #,(Q)). 

Let Xe X. Then its discontinuities can be arranged in an order: 


Ts Tie Tt 1 ass Pape a ees aes a ee (1) 


where either for some ordinal number x < w? we have t, = 9, or for all ordinal 
numbers a < œ? we have t, <a, and lim, ton =¢. 

If X = {x(t),1<o}€H p, then its discontinuouities can also be arranged in 
this order: 


O = To, Ty Tasei To Totis To ey Tames Tpl ial lyse (2) 


where the k; are non-negative integers and | >n. We shall define the kth-order 
instantaneous return process by induction. ; 


Definition 2. We say X = {x(t),t<o}€H#Hp is a kth-order instantaneous return 
process, if X is not an nth-order (0 <n < k — 1) instantaneous return process, 
and either there exists some ordinal number « < w**? such that t, =<, or for 
all ordinal numbers æ < w**' it is true that t, < g, and furthermore t,x»: = G. 
The class composed of kth-order instantaneous return processes is written as 
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HW. The class composed of kth-order instantaneous return Q processes is 
denoted by #,(Q). 

Suppose Xe#’,(Q). We call the embedding chain X? = {x(z,),t, S Tap the 
zero-order embedding chain of X, where ty is defined by (8.9}-(8.11), the one-step 
transition probability of X9 is 


oll; = Pi{ x(t) =j) (3) 


We call X3 = {X(ton) Ton S Tog} the first-order embedding chain, where ty, 
can be defined by following (8.9)-(8.11). The one-step transition probability of 
X} is 


:ll;; = P,{x(t,) =}} (4) 


Xx = {X(T unh Tom S Twig} is the ith-order embedding chain, where t can be 
defined by following (8.9)-(8.11). The one-step transition probability of X} is 


ill; = P{x(t,3) =j} (5) 

Similarly, we can define 
ol, ;(4) = E,{e~ a x{t,)=J) A>O (6) 
H(A) = E{e “w, x(t) =F} A>O (7) 


Just as in sections 7.12 and 7.14 according to oI, ,M(A} we could determine 
Martin boundary ĝE, essential Martin boundary B, Martin exit boundary B., 
Martin passive boundary B, atomic exit boundary B,,, non-atomic exit 
boundary B,,, atomic passive boundary B,,, non-atomic passive boundary B,,, 
and so on, so according to JH and ,II(4) we can determine [th-order Martin 
boundary {0E}, /-order essential Martin boundary ,B, ith-order exit boundary 
1B., ith-order passive boundary ,B,,/th-order atomic exit boundary ,B,,, ith- 
order non-atomic exit boundary ,B,,,/th-order atomic passive boundary 
:B,,,lth-order non-atomic passive boundary ,;B,,, and so on. Much of the 
boundary theory of the minimal process, ie. zero-order process, can be 
transplanted into kth-order instantaneous return processes. For instance, for a 
kth-order instantaneous return process X = {x(t),t<oa}eW,, if we let 


«Qr = {there exists an ordinal number æ < w+! such that t, = 0 < 00} 
and 


xu = {for all ordinal numbers a < w**! it is true that t, < a} 


+ {there exists an ordinal number « < w*+! such that t, = = œ} 
H = (oH) U(oB,)U(, B) O UG 1B.) oH =H oB, =B. 


Then on .QF we have x(o ~ 0)e,H, on ,Q,, we have x(o — O)e,B. Similarly to 
Theorem 12.5 and Theorem 12.8 we have the foliowing. 
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Theorem 1. Suppose X = {x(t),t <oa}e#,. Then for all ic E we have 
Pio < x {x(a — Oe, B,} = 1 
Pio = wlx(o —O)e,B,} = 1 


Pi{o < volx(o —O)e,H} = 1 


(8) 
(9) 
(10) 


CHAPTER 8 


Construction of O Processes 
with Finite Non-conservative 
States and Finite Exit 
Boundary 


8.1 INTRODUCTION 


For construction of general Q processes we often suppose that Q is conservative. 
Under this supposition, Feller (1957a) for the case of finite exit boundary and 
finite entrance boundary has constructed all Q processes satisfying the system 
of forward equations. Under the same supposition, Xiang-qun Yang (1966a) 
has constructed all Q processes. Williams (1964, 1966) and Chung (1963, 1966) 
in the case that Q is conservative and has a finite exit boundary found all the 
Q processes. Xiang-qun Yang (1982, 1983a), for the case of Q having a finite 
set of non-conservative states and a finite exit boundary (simply called bifinite), 
has constructed all the Q processes, but the results obtained are not very 
obviously related with those in Williams (1964, 1966). For this reason, by means 
of methods similar to those used in Williams (1964, 1966), Da-guo Xiong 
(1980, 1981) has constructed ali the bifinite Q processes, but his results are still 
not very obviously associated with those in Feller (1957a) and Xiang-qun Yang 
(1966a). In this chapter, we shell, under the bifinite condition and 
according to the methods in Feller (1957a) and Xiang-qun Yang (1966a), 
construct all the Q processes, and point out the relation with the results obtained 
in Williams (1964, 1966) and Da-guo Xiong (1980, 1981). The content of this 
chapter is taken from Xiang-qun Yang (1983b). 


8.2 BASIC HYPOTHESIS AND THE CONDITION 
SATISFIED BY F“()) 


Given a matrix Q=(q;,) satisfying (2.2.6) and with d=Q! as the 
non-conservative quantity, let H, = {i:d;> 0} be the set of non-conservative 
states and B, be the Martin exit boundary induced by Q. 
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Basic Hypothesis 
Suppose that A, = H.U B, is a finite set, H, or B, may be empty. But when B, 
is empty, either ¥ 7 is not empty, or 
inf A>’ p) =0 4>0 (1) 
Aj 
Under the basic hypothesis the Q process is not unique. When acH.,, 
X (A) = (A) d, is an exit family, and 
XAVTX = Tad, 440 (2) 
AXA) Sig, A> (3) 


Write X(A) for the maximal solution of A + (1), X(4)t X(A{0). If B, is non-empty 
and finite, according to the discussion of sections 7.13 to 7.16, we can select an 
exit family X"(4) (aeB.) such that X(4) = Eses, X°(A). Moreover, 


XF(A) > Og, a,beB.,i—b (4) 

X"(ATX” A{0,aeB, (5) 

AX%(A) 30 acB.,A4-> œ (6) 
XF(2} 30 aeH„i>beB, (7) 


Thus under the basic hypothesis, we can select a harmonic exit family X*(A) 
(ac A.) whose standard image is X*(aeA,), such that 


Ap(A)l = 1 — Z(A) Z(Ay= 》 XA) (8) 
acAe 
Z(ANTZ= 3 X° ALO (9) 
acAg 
X =Yucp. X° and X° = | — Z are the maximal exit solution and the maximal 


passive solution of Q, respectively. The X°(A)}(ae A.) are linearly independent. 

In fact, suppose >,.4.¢°X °(A) = 0. By (7) we get Dace. C° X° (A) = 0 and so by (4) 

we obtain c* = 0 (ae B,). Hence Zpen, °X") = 0. By Lemma 2.11.6 c° = 0(aeH.). 
According to Theorem 7.18.1, and Q process w(A) has the following form: 


VW = BD + 2 XAFA) (10) 
aede 
where 
F(A) 20 ALFA), 1] < 1 (11) 


Lemma 1. For yo in (10), the norm condition is equivalent to that (11) holds 
for every ae A, The resolvent equation is equivalent to that for every ae A, the 
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following holds: 


PYAA(A, p) = Fu) + (u — A) 2 LEA), X’) IP (12) 


be Ae 


where A(A, u} is as in (2.10.7); (12) is also equivalent to 
PSA) — F'(p) = (u — DF (MY (13) 


The Q condition is equivalent to that, for every ae H, the following holds: 


lim AFA) =0 (14) 


A> 


Proof. The necessity of condition (11) for the norm condition has already been 
pointed out previously. The sufficiency follows from 


AW(ANL=1-— 3 XA 》 XAF C), 1] 
aEAc aede 
and (11). 

Substituting Y,a in (10) into the resolvent equation, because (A) satisfies the 
resolvent equation and X%(/)(aeA,) is a harmonic exit family, and moreover, 
is linearly independent, we know that the resolvent equation for w{A) is 
equivalent to (12). Substituting y(A) (10) into (13), we find (13)is equivalent to (12). 

Noting that (A) satisfies the Q condition and observing the finiteness of A. 
we find that the Q condition for (A) is equivalent to 


lim ÀX; (AAF (å) =0 acA. 
A> 加 


By (3) and (6), the formula above is equivalent to that for every ue H. (14) holds. 
QED 


83 SIMPLIFICATION OF THE PROBLEM 


Definition 1. Suppose a and beA,. We call a and b indistinguishable if for all 
A> 0, F(A) = F*(A) holds. 


Obviously, the indistinguishable relation is an equivalence relation. According 
to the indistinguishable relation, A, can be decomposed into disjoint equivalence 
classes al a2,...,. We can think of the equivalence class a, as a new boundary 
point, and write 


A = {a),a,...} A=HvuUB (1) 
H = {a:aeA,anH, # Ø} B= {a:aeA,anH, = ¢} (2) 
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Write 


YZE XAY =E acdi0 O 


bea bea 


Then (2.10) becomes 
PA= BV + 2 YAFA) (4) 
acA 


All the boundary points in A are distinguishable. 


Lemma 1. There exists a subset Jc A and an A x J matrix G=(G%), whose 
columns are non-zero and whose rows satisfy 


G*>0 7 G” < 1(aeA) G” = 1 (aed) (5) 
beJ 
such that 
Fs(4) = 3 G F*(A) aceA,A>O ; (6) 
beJ 


And for each aeJ, F°(4} cannot be represented by the following form: 


F(A) = 了 h® F(A) 1>0 (7) 


beJ 
where 


h= 0 h > 0 X het > 1 i (8) 


beJ 


Especially, we have F°(4) # O(aeJ). 


Proof. It is obvious that there exist a subset J c A and an A x J matrix G such 
that (5) and (6) hold. For instance, it suffices to take A to be J, and to take G 
to be the unit matrix. But then (7) and (8} may hold for some aeJ. 

Suppose there exist J c A and an A x J matrix G such that (5) and (6) hold, and 
there exist age J such that (7) and (8) hold for a = ay. Then by (6) and (7) we obtain 


F4A)= 》 GPF? (A) acA,A>dO 
beta 
where Jo =J — {ao}, and the element of the A x Jy matrix Go =(G@’) are 
Gar = G? + Gath, ae A, bedo. 
By (5) and (8), G satisfies 


Ge >0 SG? <1 (ae A) Go = 1 (aeJo) 


beJo 
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Thus, after substituting J, and A x Jy matrix Go for J and G, (5) and (6) still 
hold. Going on like this, we can finally get a subset J and an A x J matrix G 
such that (5) and (6) hold, while for every aeJ, (7) and (8) cannot hold 
simultaneously. Finally if some columns in G are zero columns, then substituting 
J —{beJ: the bth column of G is a zero column} for J we can meet the needs 
of the lemma. The proof is completed. QED 


Lemma 2. Every Q process (A) has the form 


Wild) = bid) + 2 ZAFE) (9) 
aeJ 
where the subset J c A and all the boundary points in J are distinguishable, and 
ZA = 》 ¥%(A)G” beJ (10) 
acA 


is a linerly independent harmonic exit family. Each column of the A x J matrix 


_ G =(G®) is non-zero and satisfies (5), and is such that (6) holds; for every acJ, 


(7) and (8) cannot hold simultaneously. Especially, F*(A) # O(aeJ). 


Proof. Substituting into (4) we get (9). Since X%(A), acA. is a linearly 
independent harmonic exit family, it follows that Z°(A)(beJ) in (10) is a linearly 
independent harmonic exit family. The remainder of the conclusion follows 
from Lemma 1. The proof is completed. QED 


Lemma 3. Suppose the Q process (A) has the form (9) in Lemma 2. Then the 
norm condition of y(A) is equivalent to 


F%(4) > 0 ALF7(A), 1] <1 aed {11) 

The resolvent equation is equivalent to 
FADA, p) = F°(u) + (u — NY LFA), ZUD] FP) ae] (i2) 

beJ 


The Q condition is equivalent to 


lim 2F*(A) =0 acd y (13) 
Arm 
where 
Jy =JOH = {acJ:an H, + Ø} (14) 
Ja=JoB = {aeJ:aNnH.= Ø} (15) 
J (16) 


Proof. It follows by using Lemma 2.1 and Lemma 3.2. QED 
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Write 


hae y YG” beJ (17) 
ae A 
Z*(A=ZA-¥ ZAa=¥ ra 1 一 》 ar) (18) 
bet acA beJ i 


z=z-y2=y (1-70) (19) 
beJ 


acA beJ 
Then obviously 
ZA) Z°(beJ) ZrATZ* A4\0 (20) 
X°+Z*+ >) Z°=1 (21) 


aet 


8.4 GENERAL FORM OF F(X) 


Lemma 1. Suppos gel, then | 
CHlal<teAGAvi<Culgl . (1) 


Here |\g|| represents the norm in the Banach space /, and 


Cust Aon | (2) 
y 
Proof. From the definition of A(A, v), 
|à — »| 
gA, vil < ilgi + E [lgl vý] 


Av 

<iigll+ lgl, 1]= Calig ii 

The right-hand inequality in (1) follows. The left-hand inequality follows from 
all = WGA, v) Af, AI < Cy, GAG, v) QED 

Lemma 2. Suppose the non-zero F*(A)(aeJ) satisfies (3.11) and (3.12). Then there 


exist non-negative numbers M**(j)(a,beJ) and a harmonic entrance family 
n°(A)(aeJ) such that 


F(a) = $ M” AnA) aeJ (3) 
beJ 


Furthermore we can also select numbers M®(å) and n?(4) having the following 
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properties: 
(i) 4°(A)=0 if and only if M*(A) = O(aeJ), 
(ii) there exists a non-negative J x J matrix H =(H") such that 
n(A) = 》 H(A) aed (4) 
beJ 


(iii) there exist positive numbers v,(aeJ) such that when u moves along some 
subsequence pt, — œ then 
M*(y) 


He 由 =- 一 一 大 H’? „beJ 5 
= TEDA v aes e 


If 7°(A} #0 then in the sense of strong convergence, when pt = u, > oo， 


F°(wyA(y, A 
Hap) =, ay © 
|| F"(u)A(u, Ya) | 
Proof. First note that for all A, >0, F°(A)A(A, is non-negative. In fact, by 
the definition of A(A, p) when 4 > u the conclusion is obvious. When 4 < p, since 
the right-hand side of (3.12) is non-negative, so is the left-hand side. Because 


_ F*(A)is non-zero we know || F*(A)A(A, 42) || > 0 by (1). Multiplying (3.12) by A(u, 4} 


from the right we obtain 


F°(A) = 之 AH (v4, 2, WA? (vo, A, p) (7) 
where v, > 0 is arbitrary, and 
M*(v, A, u) = 0"(A, DIF (DA v) | (8) 
ao(à, u) = ao + (u — ALFA), Z°(H)] (9) 
F*(u)Al u, A 
BRORS ai ie i i si 
Obviously 
InP, v, w) || = 1 (11) 
On account of (2.10.9) and Lemma 1 
Cr <i Aw <C,, (12) 
Cy,’ M* (4, A, u) < M” (v, A, u) < Ci, MPN, (13) 


Taking v, =v > 0 in (7) we have 


F°(4)= È; Mv, A, un (v, A, p) (14) 


beJ 
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From (12) we derive 


1/4 > FAI > YM, AC; (15) 
beJ 
C,/22 Mw, 4,0) (16) 
aeJ 


Especially, taking 4 = v in (15) we get 
Fv) || > MP, v) . (17) 


bel 


Consequently for every beJ, either 


lim M(v, 2, 2) =0 


Boo 
or 


for some å > 0, some v >Q and some aeJ (19) 


Hx; 
By (13) the formula above is equivalent to 


for some vy > 0 and some aeJ (20) 
>w : 

Assume the whole of beJ that makes (18) hold to be Go: then 一 Co 天 Ø. 
Because, otherwise, by (14), we derive F*(4) = 0 which contradicts the hypothesis 
that F°(A) is non-zero. Therefore there exists b; €J — Go, v(b,) > 0, a(b,)eJ and 
a subsequence p,(1)— co such that 


M20Pi(y(b,), v(B,), Mali) > MO (WP) > 0 (21) 
hold for i= t. Assume the whole of beJ that makes (18) hold to be G, when 
u= p (1)> œ. Then Goc G, b\eJ—G,. If G,u{b,}=J, then we take a 
subsequence p, = 1,{1). Otherwise, there exist b,eJ —(G,U{b,}), ¥(b2) > 9, 
a(b,)eJ and a subsequence 1,(2) of (1) such that (21) is true for i = 2. Because 
J is finite, there exist A = {b,,53,...,0,} © J and a(b,), a(b,),...,a(beJ, v(b,), 
v(b,),..., ¥(b,) > 0, and a subsequence H, > 00, such that 


lim M(v, an) = 0 (22) 


n> wo 


For beJ — A and al aeJ, v>0,å4>0, 


lim M2" (v(c), v(c), ua) = M***(v{(c)) > 0 ceA | (23) 


noo 


On account of (11) and (17), and by applying the diagonal method, we can 


for all v > 0,4 >0,aeJ (18) . 
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select a subsequence of u, again to be denoted by u, such that for every ceA 
we have 


lim M*(v(c), v(c), u) = M(v(c)) a,beJ (24) 


用 一 oc 


lim 47 (v(c), ¥(C), Hy = NG(V(C)) 


ao 


beJ, jek (25) 


and moreover 
M*(y(c}} > O(ceA) M(v(c)} = O(ceA, aed, beJ — A) (26) 
Letting 2 = y = v{c) in (14) we obtain 
F*v(c)) = > M*(v(c), v(c), OP v(e), u) ceA (27) 
beJ 


Letting H = u, —> 00, we get 


F%(v(c}) = 2 M™{v(c))n (le) (28) 
Thus 
| F°(v(c)) || = 2 Mv Or (vo) (29) 
eA 


` Letting v = v(c) in (17) and taking the limit we derive 


LEOS Z MP (le) (30) 


beA 


By (11) and Fatou’s lemma we have |! 4°(v(c)}|| < 1 (ceA, beJ). Comparing (29) 
and (30) we obtain 


I] °(v(b)) || = 1 beA (31) 


Thus when beA, 7°(v(b), v(b), 4,) converges to y°(v(b)) in coordinates, and the 
sequence of norms ||4°(v(b), v(b), u} = 1 obviously converges to the norm 


li7°(v(b)) || = 1. Thus the convergence is a strong one in the Banach space |, 
that is 


Il 7°(v(b), vb), 42,) — 9°(v(b)) || +0 beA (32) 
Write 
n°(A) = n°(v(b))A(v(b), å) 
Then y°(4) (be A) is obviously a non-zero harmonic entrance family. By Lemmal 


ln V(b), A, Hn) — (ADI < Coal a’), vB), a) — wb = 0 (33) 
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Now for every weJ and À >0, we can select a subsequence of jip and still 
write it as jp, such that 


M(v(b), A, Ha) > M@(A) beA (34) 
Letting “= p, 00 in (7) and noting (34) and (32) we find 
F(A) = $, M®(A)n*(A) 
bed 


For beJ — A, we add the definition that y°(J)=0, M%°(A) = 0(aeJ). Thus we 
have proved (3), and (i) in Lemma 2, and (6). 
By (3) we have 


F'(p te? 
*(A, 一 一 a ! 35 
eau a ) up 
where v, = v{a), and 
M” (1) M2) 
H” r (36 
HA TFDA YO Faes MDI 9 
Because 
È Hu) Yin’) =1 (37) 


and ||°(v,)|| > 0 when bA, then H”? (u) = 0 when beJ — A. So that when p tends 
to infinity along some subsequence of u, the limit in (5) exists and is finite. 
When n°(4) £0, that is, acA, by (33), 4°(A, Ha) = 9°{(Ya 4, Ha) converges strongly 
to *(A). Hence when (A) #0, (4) follows from (35). When 7°(A4) =0, taking 
H = 0(beJ) (4) obviously holds. The lemma is proved. QED 


8.5 NON-STICKY CASE 


Definition 1. A harmonic exit family (4(4), 4>0) is said to be sticky if. 


lim, . 4 {| (A) || = œ, otherwise it is said to be non-sticky. If in the representation 
(3.9) and (4.3) of a Q process y(A) every 4°(A) is non-sticky, then we say that 
the process (A) is non-sticky. 


Theorem 1. (i) Decompose A, = H, UB, into A, =a,Ua,VU..., where every am 
is non-empty and they are mutually disjoint. Write A = {a,,a,,...}. Take a 
non-empty subset J of A, and J =J,,UJ,, where 


Jy = {aeJ:anH, + Ø} J, = faeJ:anH, = Ø} 
(ii) Take an A x J matrix G = (G*) satisfying (3.5), where each column of G 
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is non-zero. Write 


zo. >,» XG” beJ {1) 


acA cea 


ZA) = § F XG" 


AEA cea 


z*()= Za - 7 zü-=F (5 xw): y c") D 


aeJ aed \ cea beJ 
Zr*=Z_ 了 Ze- 了 (zj on) 
aed acA \ cea beJ 


(iii) Take a non-zero and non-sticky harmonic exit family (47(A), 2 > 0)(aeJ). 
Write 


wd) = ALAA), Zt Ww AT oo (3) 
Wwe*(d) = AERA, Z*] 1 Ww AT x (4) 
a" = A[yt{a), X°] (5° is independent of å} (5) 
oe = lim Ay*(A) (6) 
A> w 

such that 

C+ Wty wri (7) 
beJ 

x= 0 if aeJy (8) 

(iv) Let 
pilh) = pyl) + 2, 2, ZI KTR) (9) 


where the J x J matrix K(A) is given by 
K(4)=(K"(4)) = [1 -W + WA)! 


a aie tc ae aan (10) 
W(A) = (W%(A))T W = (W%) AT x 
and I =(6,,) is the J x J unit matrix. 
Then y(A) is a non-sticky Q process, which is honest if and only if 
w* =0 e+y wernt (11) 


beJ 


The Ņ{2} is of B-type if and only if J, = Ø. The (A) is of F-type if and only if 
a’ = 0 GE {1 2) 


Every non-minimal and non-sticky Q process y(A) can be derived in the way 
above. 
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Proof. (a) Suppose that the Q process w(A) is non-minimal and non-sticky. 
Substituting (4.3) into (3.11) and (3.12) we obtain 


F MP + SAF E SPAKI l (13) 
beJ beJ 
> MPA = >》 U — S(A) + MAW)” Fiu) (14) 
beJ beJ 
where W/(A) = (W(A), S(4) = (S®(4)) are J x J matrices, 
WA) = AL ytd), Zt we to (15) 
W**(A) = AEA), Z*] 1 W* At oo (16) 
6° = Al H(A), X°] (a° being independent of 2) (17) 
S) = F MAW) (18) 
cet f 
S™ (2) = F. M”) W (A) (19) 
ced 


As Ņ(å) is non-sticky, W =(W*) and W** are all finite. 
Select a subsequence 4 一 oo such that 


Mo) 一 MY SHA) > S? 5°*(A) > S** (20) 


It is plain that S$”, S** are all finite. We are going to prove M® finite. When 
(A) = 0 obviously M?"(A) = 0 M® = 0. Suppose A = {beJ:9(A) # 0}. By (13), 
(18), (19) and Fatou’s lemma we have 


Y M“ +S* +} SP <1 (21) 
ced beJ 
Y MEW* <S™ a (22) 
ced 
py M“ we < gab (23) 


ced 


(setting oc-0 = 0). So by (21)-(23), 
> Man (à), 1] = > M*ALy‘(A), 1] 


ced cet 


=>) me (of +W*aty we 


cet beJ 


< MoS + y M“ W* 十 区 z mewe) 
el 


ced ced beJ F 


<1 
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and therefore when beð., M® < œ. Thus the J x J matrix M =(M“) is finite. 
Hence the equalities hold in (22) and (23). 
Taking the limit in (14) we get 


E Men) = E U -MW + MW FW) (24) 
E€ beJ 
Write 

F(=} Mn (A) (25) 


cet 


Then (24) becomes 
(nu) = YU W + WP) (26) 
beJ 
Note that 六 (四 is a non-zero and harmonic entrance family. Actually, if 
(uw) =0, then W(u) = 0, W* =0, and hence by (26) we have F°(1) = 0, which 


contradicts the non-zero property of F(z). Thus nf7°(1),1] > 0. 
The matrix W — W(y) is non-negative, and the row sum satisfies 


2 (We — WD] = ¥ We uii, 1 — X° — Z*] 


cet cet 
= + Wo* + We — uly), 1] 
ced 


<1— ula u), 1] <1 


Accordingly the inverse matrix in (10) exists and is non-negative, and 
furthermore 


K(ay= 2 [W - WT (27) 
By (26) we have 
F%(y) = 2 K”) (28) 
beJ 
An so we obtain (9). 
Noting that 
lim K(A) = Y (W —W)? = (29) 
A> n=0 


by (28) we know that the Q condition (3.13) is just (8). 
(b) Suppose that (A) is determined according to (i)-{iv)in Theorem 1. Because 


W(A) = K(A)"1—~14+ W 
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by (28) and after simple computations we derive 


ALFA. =1- F keol 人 1 6 Wy w=) 


beJ cet 


— $ K”(4 ACW ’* 一 W*(A)} < 1 (30) 
beJ : : 

The equality in the formula above holds if and only if the equality in (7) holds 

and, moreover, W°*(A) = W°* (be J). Considering (2.11.40) we have 


(u — AET), Z*(A)] = WP* (un) — WP*(A) 
Therefore when u ¥ 4, [4°(u), Z*(A)] = 0. Whence [4°(u), Z*] = 0, W°*(u) = 0. 


Thus W?*(j) = Wt* is equivalent to Ws* = 0, 
A simple computation shows that 


KAEWA — WIKU = KALKA — Ku) 1K) = KW — KA) GD 


Applying the above formula we can easily verify that (3.12} holds for the resolvent 
equation of y (4). We have pointed out that (8) is just the norm condition (3.13); 
therefore y(A) is a non-sticky Q process. 

(c) Suppose that W(A) is of B-type, that is, the B condition is satisfied. We 
proceed to prove Jy = Ø. If Q is conservative, the conclusion is trivially true. 
If Q is non-conservative, by Theorem 2.12.1, F*(A)=0 (ae H,) holds in (2.10), 
and so F%(A) = 0 (aeJ,,) in (3.10). But by (28), every F°(1) # 0 (aeJ). Hence surely 
Jg = Ø. Or else, if Jy = Ø, then for every aeJ = Jp, (AI — Q)Z*(A) =0 holds. 
Thus the B condition of (A) is satisfied, that is, Y(A) is of B-type. 

The F condition of (A) is equivalent to 


0= F F ZAKAR — Q) = F Zz) > K*(A)ae 


act bej aed 


Since Z*{A)(aeJ) are linearly independent, K(A)~! exists. The above formula is 
equivalent to #? =0, beJ. By (8) it is also equivalent to (12). The proof is 
completed. QED 


8.6 GENERAL CONSTRUCTION 


Lemma 1. Suppose aeJ, and (3.11) and (3.12) hold. If for some A> 0, we have 
S(A) = ALFA), Z7] = t (1) 

then (1} holds for all 4 > 0 and there exists a non-zero and harmonic entrance 

family 4°(A), à > 0, such that 

六 (人 Fe(O4U A) 


F? 
oF wer(A) | F(u) Alp, val 


=n") i (2) 
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Here v, is a positive number chosen such that ||/7%(v,)!|=1, and W*(A) is 
determined by (5,15). 


Proof. By {1) and (3.11) we have A[LF%A4),Z°]=0 for beJ, b#a, so that 
ALFA), Z°(u)] = 0. Consequently (3.12) becomes 


PYA)A(A, p) = F(a) + (u — ALP"), Zw) FH) 


Since F#(j) 4 0, it follows that 1 + (u — A)LF%(A), Z°() J > 0. By imitation of the 
proof of Theorem 3.2.1, we know there exist a non-zero harmonic entrance 
family (A), A > 0, and a constant c* such that 


"(4) 


一 一 一 一 一 一 A>O 
ca i WA) 


F(A} = 
By (1) we know c*=0 so (1) and the first expression in (2) hold for all À > 0. 
Normalizing y°“{å) appropriately so that || 4°(v,)|| = 1, the second expression in 
(2) holds. The proof is terminated. QED 


Theorem 2. (i) Select the set J and Z*(A), Z“(2), ae J and Z*, Z’,aeJ according 
to (i) and (ii) in Theorem 5.1. 
(ii) Take a subset L (L may be empty) of J, and set 


Bey. pers © 
(iii) Take a non-zero and harmonic entrance family (4°(A), A > 0), ae J, such that 
om ALA C), 1 — Z°] < œ aed (4) 
一 四 
or equivalently, according to the notation in (5.3)-(5.6), 

| W* < oo W < oo a,beJ,a#b (5) 

(iv) Take a non-negative J x J matrix § = (°) such that 
S“ =0 S** > W°* So > we a,beJ,a#b (6) 
G+ WY SPSE aeJ (7) 


beJ 
(v) Furthermore, the following two equations should hold: 


(L + We)" 1g =9 if beJy (8) 
NÈ + Wy tat = 0 if aeJmbEJg (9) 
Here JeJ matrix N(A)| N = (Ne At oo， 


N(å)= [I — R(A)]7! = È Rw (10) 
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aaj ^y __ ab Ss fe — Wwa) 了 | ] 
RA) = 0 RA) = re + wa) {a £b) (11) 
N= > R" R = (R) (12) 
n=0 

aa __ t= — W% 

RY =0 aa pe (a #b) (13) 
(vi) Let 
PA= pA E ZUR RA (14) 
a,beJ 


where the J x J matrix K(å) is given by 
K(A) =(K*(4)) = [f— S + Wa) = N(A)D(A) (15) 


and Ï is a diagonal matrix with L’, acJ, as its diagonal elements. D(A) is a 
diagonal matrix whose diagonal elements are 


Í 
D(A) = -= 一 一 一 一 aeJ (16) 
E + WA) 
Then (A) is a Q process. Every Q process Ņ(4) can be obtained in the way 
stated above. The process is honest if and only if 


sec EDIT aeJ . (7 
beJ 
Remark 1 
For the process Ņ(4) in Theorem 2, if aeJ — L, then 
ALAA), 1] = W) > 0 (18) 
Fy = EA (19) 
WA) 


Actually, from (6) and (7) follows {18}. Furthermore, from 
F(A) = 》 K”) 
beJ 
we obtain 


A= S Waray  — (20) 
beJ A 


By (6) and (7), the above expression becomes #°(A) = W%(A)F (A); therefore we 
get (19). 


Proof of Theorem 2. (a) Assume ¥(A) to be a Q process. Then (5.13) and (5.14) 
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still hold. By Lemma 1 we can write 


L= la:aeJ,S™(/} < 1} (21) 
Let 
E e (22) 
| F°(A)A(A, va) || ifaeJ—L 
Then 5%A) > 0. Dividing (5.13) and (5.14) by 6%) we have 
》 MPU’ + S*(A) + ¥ SPA <L (23) 
bel beJ 
> M” = VU — SA) + MAW) Ir) (24) 
beJ beJ 
where 
-abr _ MPA) Tair sagn SCA) 
ab aa os ax = 
MA) = a) S(A) = 0 S**(A) A) 
B SA) (25) 
ab nee 
SA) = 5A) {b +a) 
satisfies 
Se= F MDW) bza 


cet 


SA) = 5 M*(A)We*(A) 


cet 


(26) 


Select a subsequence 4 一 œ from the sequence u, of Lemma 4.2, such that 
for all a,beJ the following hold: 


M”) M” So S**(A)—> S™ (27) 
By (23), (26) and Fatou’s lemma we obtain 
2 Mo’ + S*4 5 SPSE (28) 
beJ bej 
S” = 0 So >} Mw (b #a) 
cet (29) 


sae > F M* wee 


ced 


- {setting 00:0 =0-00 = 0). 


Obviously S** (aeJ) and the J x J matrix 5= (S%) are finite. We proceed 
now to prove that the J x J matrix M =(M®) is finite. 
When aeJ — L, by (4.6), M* = H® < œ {beJ}. Suppose aeL, below. Let 


A= fe ced, y (å) 40,0 +W*+ } W? = o} 


bte 
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If °( 2} = 0, we have M“ = 0(aeJ) from the fact that M™(A) = 0(aeJ). H(i) € 0, 
and moreover ceJ — A, then by (5.25) and (5.26) we have 


3 "(or+ We* 4: > we < 》 M“o% + S* 十 SL. 
cet b#e cet beJ 


so that Me < œ for ceJ — A, and aeJ. 
Note that when ceA, 


en (i), 1 — Z= + Wu) + W” 


ba 
so that 
uinu), 1] = Wu) > 0 
Hence 
ein (u) — Wo) Fu), Z°] = Wn) 6%) > O (30) 
Since 
2 2 M“ (AW ”( Fu) = R : M“(A) 2 WF + 2 MAW (u)F" (p) 


(24) can be rewriten as 
E MDI — Wu) FC) J 


ceA 


= Fe( 有 人 一》 S*AP (w+ YM "a( SSW (uF) — r) 
beJ 


bta cel- AÀ 
Multiplying the above expression on both sides by uZ“, we have — 
Y MAW = SH F, SHAS 了 MAY WPS u) — Wu) 
beJ 


CE 入 ba ceed- A 
When 1 一 oo, the limit on the right-hand side is finite, and so is the limit on 
the left. Noting (30) we have M“ < oo (ce A). Thus we have completed the proof 
of (M*") being finite. 

Letting 4 一 2 in (24) we have 


$ My (un) = > U S+ MW(p) 1? Fp) (31) 
beJ beJ 
If we write 
q'a) = X, M”l) (32) 


beJ 
then (28), (29) and (31) become (6), (7) and 
7H) = YFP -S + WF ， P3 


bed 


a o A A ll a a A n A a a a A i r a a. 
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We proceed now to prove that the inverse matrix 
Kim =(F-S+ Wy]! (34) 


exists and is non-negative. 

Actually, the diagonal elements of 7 — § + W(y) are non-negative, while the 
non-diagonal elements are non-positive. In order to prove that the inverse 
matrix exists, we only need to prove that the row sums are bigger than zero. 
When aeJ—L, by (6) and (7) we know the row sum is equal to 
W° u) = uR lu), > 0. When aeL surely 4°(u) #0. Because if 7°(1) = 0, then 
F%u) = 3,.,5°F*(), that is, (3.7) and (3.8) hold for h® = 5. But by Lemma 
3.2, this is impossible. Therefore when ac L, we have #(u) #0. Thus by (6) and 
(7), the row sum 

1-YS*+ > we 


beJ beJ 


>1- (r +S*4 > 5”) ++ W*+ YW) > piia 1 >0 
beJ 


bej 


Hence (15) holds, and from (33) we find that 


FA) = VK AA) (35) 
bej 
So (14) is proved. 
(b) By (15) and (10)-(13), the Q condition is equivalent to 
2, N”(L + WY) a = 0 aeJ y (36) 
bes 
Since N > 1 (aeJ,), it follows that the above expression is equivalent to (8) 
and (9). 

(c) Suppose (A) is determined by (i)-(vi) in the theorem. 

Noting W(A) = K(4)"* — I — S, and imitating the proof of the norm condition 
in Theorem 5.1, we know A(F(), 1] < 1, and furthermore equality holds if and 
only if (17) holds. 7 

But (5.31) still holds for K(A) in (34), and hence we come to the conclusion 
that the resolvent equation of (4) holds. We have already pointed out that (8) 


and (9) are equivalent to the Q condition. Therefore (A) is a Q process. The 
theorem is proved. QED 


Theorem 3. Suppose that y{2) is the Q process in Theorem 2. Then WA) is of 
B-type if and only if Jy = Ø and of F-type if and only if 


g =0 (aeJ) 


Proof. The same as in Theorem 5.1. QED 


232 CONSTRUCTION OF 0 PROCESSES WITH FINITE NON-CONSERVATIVE STATES 


Theorem 4. If (À) is the Q process of Theorem 2, then (A) is non-sticky if and 
only if 


lim AAA) < co aeJ (37) 


Arta 


Proof. Suppose (37) holds. According to Definition 5.1, (å) is non-sticky. 


Conversely, suppose (A) is non-sticky, that is y(i) has the representations (3.9) 
and (4.3). Moreover 


lim Aliy 4) < oo aeJ (38} 


á> o 


wl) has the representations (5.9) and (6.14). As Z%(4}, aeJ, are linearly 
independent, so 


E KPA = È} KA) aeJ 


beJ beJ 


Hence 


Multiplying the above formula from the right by A(A, u), we find that 
AD = $ EKT 1 KA] (es) 
beJ 


Bee (39) 
KIAD = $ EKA) KAT? x ln?) | 
bet 
By the above expression and (38) we obtain (37). The proof is completed. 
QED 


Remark 2 


In the representation (14) of the Q process y(A) if #°(A), aeJ, and 7°(A), aeJ, 
correspond to the same (A), from the proof (39) of Theorem 4 we see that there 
exists a J x J matrix R=(r,,) such that the inverse matrix of R exists and, 
moreover, 


H(A) = 2 ra A) A>0 
beJ 


8.7 EQUIVALENT CONSTRUCTION 
Theorem 1. {1) The same as (i) in Theorem 6.2. 
(ii) Take a non-zero entrance family (1"(4), 4 > 0), aeJ, such that 


lim A[y%(A), 1 — Z7] < oo CEJj .| (1) 


Arta 


-一 -一 一 rr 一 -一 一 一 一 
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or equivalently 
Wo* <o W® < œ (b #a) aeJ (2) 
(iii) Take a J x J matrix T =(T*) such that 
oS<—W*+) T” (3) 
bed 
we < —T% (b a) (4) 
(T + We)" tat —0 beJy (5) 
Foy + Wy tat —0 aeJn, beds (6) 
Here the J x J matrix 
F(A) = (F(A) | F =(F") Ato 
and the J x J matrix 
P= Vay t= YS varlF= Sv" ate 
while a = 
V(A)= (VA) LV = (V) AT oo 
_ Tob) por 
vA) =0 VA) = Sa (b +a) 
— T%) Wat 
V“ = 0 V = Sl (b +a) (7) 
(iv) Set 
Wilh) = Pi fA) + 2 之 ZAK” AnA) (8) 
where 
K(4)=(T + WD] = U — VD] EA) (9) 
and 
E(A) = diag{[T” + W(A)]-"} (10) 


Then y(A) is a non-minimal Q process. Any non-minimal Q process can be 
obtained according to the above method. 


Remark 


When Q is conservative the y(A) in Theorem 1 is precisely the construction in 
Williams (1964, 1966). 


Theorem 2. Assume w{A) to be the Q process having the form of Theorem 6.2. 
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Let 
T=1-S n°(A) = (A) GE ` (11) 


Then (A) is a Q process having the form of Theorem !. Conversely suppose 
that W{A) is a Q process having the form of Theorem 1. Let 


L= {a:aeJ, T” > 0} (12) 
S** =0 5” =0 (beJ) ifaeJ —L 
= ws* on T = Th (13) 
Set 一 Ts 54 — 9 S> 一 = (b Æa) if agL 
F) = o ifaeJ—L a 
nA T” if aeL 


Then (4) is a Q process having the form of Theorem 6.2. 


Proof of Theorems 1 and 2. Suppose that WA has the form of Theorem 1. 
Determining L, S¢*, 5 = (5%), ñA) (aeJ) according to (12)-(14), we find that 
w(A) has the form of Theorem 6.2. Thus (A) is a Q process. 

Provided y(A) is a Q process, according to Theorem 6.2, it surely has the 
form of Theorem 6.2. And by determining T = (T®) and n%(A),aeJ, according 
to (11), we see that w(4) has the form of Theorem i. The proof is completed. 

QED 


8.8 REMARKS ON THE CONSTRUCTION OF THE 
NON-BIFINITE Q PROCESS 


Remark | 


Suppose that A,=H,UB, is an infinite set. Take a decomposition 
A,=a,Ua,U-:-. The set A= {a,,a,,...} may be an infinite set. Take a 
non-empty subset J of A. So long as the subset J is finite, or J is finite, but if 
only we define 天 (4) in Theorem 5.1 according to (5.27) and define “K(A) in 
Theorem 6.2 as follows: 


K(a)= | rea 


R(A) = (R®(A)) as in (6.11), the diagonal form matrix D(A) as in (6.16), K(A) in 
Theorem 7.1 is defined by the formula below: 


K(A) =| È vay bea) 
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V(A) = (V%(A}) as in (7.7), diagonal form E{4) as in (7.10), then the y(4) obtained 


according to Theorems 5.1, 6.2 and 7.1 are all non-minimal Q processes. 


Remark 2 


Suppose that H, is infinite and B, is finite, and that after taking a decomposition 
of A,, the set A = {a,,a,...} may still be infinite. If only we select a non-empty 
subset J of A such that J, = Ø (at this moment, J must be a finite set), the 
W(A) constructed according to Theorems 5.1, 6.2 and 7.1 are non-minimal Q 
processes satisfying the system of backward equations, and moreover at this 
moment, the Q processes constructed by Theorem 6.2 or Theorem 7.1 have 
already exhausted all the non-minimal Q processes satisfying the sysem of 
backward equations. 


PARTIV PATH STRUCTURE OF 
DENUMERABLE MARKOV 
PROCESSES 


CHAPTER 9 


The W Transformation and 
Strong Limit 


9.1 INTRODUCTION 


Professor Zi-kun Wang introduced the transforms g, and f,, and the concept 
of strong limit for the processes, during his study of construction theory of 
birth-death processes, and successfully solved the construction problem of 
birth—death processes by using probability methods. This will be seen in Zi-kun 
Wang (1958, 1962) and Zi-kun Wang and Xiang-qun Yang (1978, 1979). Their 
basic idea is to transform general processes with more complex paths into processes 
with simpler paths; then they proved that a general process is a strong limit of 
simpler processes. Professor Zhen-ting Hou applied transformations to general 
denumerable Markov processes. The W transformation is the further extension 
of the transformations g, and f,. Therefore, the results about the transformations 
g, and f, in Zi-kun Wang (1962), Zi-kun Wang and Xiang-qun Yang (1978, 
1979) and Zhen-ting Hou (1975) may all be obtained as special cases of our 
present fundamental results. The results in this chapter are taken from 
Xiang-qun Yang (1978, 1980a). 


9.2 DEFINITION OF W TRANSFORMATION 


We first discuss the W transformation for a function. Let X = {x(t},t<o} be 
a function that has a domain of values E = EU {oc} and is defined in [0,o) 
(o < œ). Then {r, B} is called a pair for X, if 


0= to <Po St, <P, so (1) 


For a pair {t, 8}, we set 


E A ifn=0 (2) 
| Vb) ifn>0 
k=1 
i= (Bu) n>0 (3) 
k=0 
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é= lim c, ô= lim 4, : (4) 
no x. noo 


whereas for te[0,¢), we set 
a, = B, + (t—4,) if telap on+1) (5) 
X(t) = x{a,) te[0, a) (6) 


Definition 1. The transformation that transforms the function X = {x(t),t<o} 
into the function X = {x(t),t <@} is called a W transformation for X, to be 
denoted by W, p- Hence X = W, p(X}. 


Intuitively speaking, we throw out those sections of the function X 
corresponding to the intervals [t; Bi), reserve those sections corresponding to 
[BB;, T4131) and move them towards the left so that the section on [ Bo, t1) gets 
to [0, t; — Bq), and link up all other sections on [fi, tir 1} (i= 1,2,...) according 
to their original order without intersecting them, and the function thus obtained 
is called X. 

We may define the W transformation for a process X, in the light of the W 
transformation for a function. 


Definition 2. Let X = {x(t)t<o}e#. Assume that for each weQ, there 


exists a pair {t(w), B(w)}, and we may determine Wi plan X (@)) = X(o)= 
{x(t,@),t < G(w)}. We call X the W transformation for the process X and write 


X =W, (X). 
9.3 STRONG LIMIT THEOREM 
9.3.1. In the case that X is a function 


Definition 1. A set A is assumed to be a Lebesgue-measurable set in [0, 00). 


Then [4, 7) is called a composition interval of A if the following conditions are - 


satisfied: 

(i) (4,) 4 

(ii) maximality: if [4,7) > [4,n), and (4,9) = A, then 
[4,7) = [A n) 


We denote the collection of ali the composition intervals of A by @(A). Put 


Cl)= U Gn) (1) 
[pE RA) 
CA(A)= U Am (2) 


[à we YA) 
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C3 (A)= {t\there exist strictly decreasing t„€C3(4) such that talt} 
= {t|there exist non-increasing t,¢C (A) such that t 41} (3) 
C}(A) is called the right closure of set A. 


Definition 2. A transformation »:u—y(u) is said to be the one determined by 
the pair {t,£} or by the sequence of pairs {t”, B"} (a > 1). if 


pu) = L{AM[0,u)} (4) 
where L is the Lebesgue measure, and 
| U Ebr Tr 1) for the pair {t, $} 
A= ne o (5) 
| Sa On beer for the sequence of pairs {7", 8"} 
n=ik=0 
Definition 3. A function X = {x(t),t<o} is said to be right-continuous, if 
lim x(s) = x(t)eE for all t <o (6) 
slt 


Theorem 1. Let X = {x(t),t <o} be a right-continuous function, and that there 
exists a sequence of pairs {t”, 8"} (n > 1) such that 


Ar= (J E DA (7) 
k=0 


Let v" and v denote transformations determined by the pair {7", 8"} for the 
given n and the sequence of pairs {t”, fp"} (n > 1) respectively. Put 


wn) m= yB) me<n (8) 
Wen nX) = X" = {x"(t},t<o"} (9) 
Then: 
(i) {7"™, B’'™} (m < n) is a pair for X”, and 
X™ = W nm gaml X”) m<n (10) 
(ii) As n- œ there exist limits 
a" ta = LA) (11) 


lim x"(t) = x(a,) for all tef0, c) (12) 


n+ oO 
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where 2, is the unique solution of the equation 
L{C,(A)o[0, u}} =t 
ueC;(A) (13) 


(iii) X = {x(a,),t <6} is right-continuous. 


The intuitive meaning of this theorem is as follows: Suppose X becomes X” 
when transformation Wm, pm 1S performed and, moreover, for m <n, the sections 
reserved when Wm, m transformation is performed are still reserved as W,,, an 
transformation is carried out. Then (10) indicates that transformation of X into 
X” can be completed in two steps. First, we throw out the sections of X 
corresponding to i~oLt;,>B8;), reserve the sections corresponding to 

i-oLB;>T74,) and, moreover, translate them towards the left according to 
their original order, then connect them up without intersecting them so that 
we have X”. In this process those sections corresponding to[ fr, ty) are preserved 
and after they move to the left Br becomes ff" while tr changes into t} 
Secondly, we abandon the sections of X” Sr 个 je Ee" By ad 
reserve the sections corresponding to |)or tyi) and, furthermore, 
translate them towards the left according to their original order and link them 
up without rendering them intersected; thus we obtain X”. 

Pau ance (iii) shows: reserve all the sections of X corresponding to 

= 人 Us Ue CB th, ,), abandon the remaining sections and, moreover, 
ae the reserved sections towards the left in their original order and connect 
them up without intersecting them, and the function obtained thus is precisely 
X. In this process of translation g, turns into t. X is also a right-continuous 
function. 

Conclusion (ii) indicates that the limit function of X" is X. 

The proof of the theorem is left to section 9.4. 


9.3.2 In the case that X is a process 


Definition 4. Let X = {x(0),t < o}, X" = {x"(t),t <o"} (n > 1) belong to X. X is 
called the strong limit of a sequence of X” and we write: X= lim,- X”, if for 
almost all œ 


o"()T alw) 


lim x"(t,w)= x(t, œ) 


n> wW 


for all t < oc(w)} (14) 


By definition, obviously, we have the following. 


Theorem 2. If X, X"E€EX, lim,..,,X" = X, then for all i jeE, t > oO, 
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lim PY. (= P; (t) (15) 


n> oO 


where {PY (t)}, {Pij(t)} are the transition probabilities of X” and X, respectively. 


~ Definition 5. Suppose that Xe.#, that By <q; < £, are Markov times relative 


to X, satisfying P(fo < o) > 0, and that the following hold: 
Bo + 06,8; = By (16) 


on (fo <t,), where @ is a transition operator. Assume that t,, 8, have been 
determined already. If 8, = a, we define t,,, = 8,4; = 0, otherwise we define 


T+ 1 = Ên +6 7, Bnri = Bn + 5,8; (17) 
We call such a pair {t, 8} a canonical one. 


Bo 本 Opati 一 T1， 


Recall the class #, of processes in which the Q matrices are finite and the 
class # of D-type processes, and we have the following. 


Theorem 3. Let XEH,, and fr, Bb} be a canonical pair satisfying the following 
conditions: 


(a) P{t+6,t, =7, forallte[Bo,t,)} = 1 


Pit+ 6,8, = B forallte[Bo,t,)} =1 (18) 
(b) For «, determined by (2.5), we have 
P{x(a,)= 00} =0 t20 (19) 


Then the foliowing conclusion holds true: 
(i) A sufficient condition for (b) is that the following condition (c) holds, that is: 
(c) P{x(t)eE forall te[ Bo, t;,)} = 1 
P{x(B,) = co} =0 (20) 
(ii) If conditions (a) and (b) are satisfied, then X = W, p(X)EN,. 
(iii) If conditions (a) and (c) are satisfied, then X = W, (XEF p. 
The proof of the theorem is left to section 9.6. 
Theorem 4. Suppose that Xe., that for every n> 1 there exists a canonical 
pair {7", 8"} satisfying the conditions (a) and (c), that 
P{x(inf £5) = 0} =0 (21) 


and that for almost all weQ the following holds: 


AM) = U LAr), rm (wo)) t Alo) (22) 
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Then 


(i) X"= W,, p(X JE Hp and (10) is satisfied, where ty", py” (m <n, k > 0) are 
tp" = L{ A" cA CO, rm)} p= L{ A" a (0, Bp7)} (23) 
(ii) There exists a strong limit of X" (n> 1) 
lim X” = X i (24) 


where X = {x(%)t < EX n Elo) = L{A(w)},a,(w) is the unique solution 
of the equation 
L{CA(A(ON) n [0, u)} =t 
ueEC+ (A(w)) (25) 


The proof of the theorem is left to section 9.6. 


9.4 THE PROOF OF THEOREM 3.1 
Assume that {t, 8} is a pair of the function X = {x(t),t <a}. Set 


A= U [Bus Te+1) B= U Etk Bx) (1) 
k=0 k=0 
y(u) = L{ An [0,x)} plu) = L{Bo[0,u)}} u<o (2) 


Obviously, we have 


Lemma 1. (i) y(u) + p(u) =u 

(ii) y(u) and p(u) are non-decreasing continuous functions. 

(iii) If weA,u<t<o, then p(u) < y(t). If ueB,u <t <o, then p{u) < p(t). 

(iv) If ue[ By, t+ 1), then p(u) = p(B,) = ôr- If ue[t,, Bi), then p(u) = y(t,) = oy. 

(v) For te[0, ë}, E = L(A) = y(o), the quantity «, in (2.5) is the unique solution of 
the equation 


y(u) =t uEA (3) 


Lemma 2. When u < o, the following conditions are equivalent to each other: 
(i) 4,<u 

(ii) y(u} >t 

(ili) p(u}<u—t 


Proof. By (i)in Lemma 1, we know that (ii) and (iii) in this lemma are equivalent. — 


Let x < u; (v) in Lemma t leads to eA, y(a,}=t, whereas (ii in Lemma 1 


-一 em 一 一 一 一- a) g 


ee ee > -e ao 
一 一 一 一 一 一 
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leads to y{u) > y(x,)= t. Conversely, let u < x. From (ii) in Lemma 1 we have 
y(u) < }(a,) = t. Therefore, {i) and (ii) in this lemma are equivalent, and the proof 
is completed. QED 


Lemma 3. Let {t, PB} and {t’, B'} be two pairs for the function X. What follows 
contains notations ‘ or ~ whose meanings are quite clear. Assume that 


AcA' (or B > B’) (4) 
Put X = W, (X), X’ = W; p(X). Then 
(i) ¢ <4’ and for te[0, 6), we have a Sa. 
(ii) Set 
GELAAG B, = LI A'n DO, B,}} (5) 
Then {?, ĝ} is a pair for X’ and, moreover, 


X = W; ;(X’) (6) 


Remark 


The intuitive meaning of this lemma goes as follows. If what is abandoned in 
the process of carrying out transformation W, a for X is more than what is 
thrown out in the process of performing transformation Wp» then X = W, p(X) 
can be derived by abandoning certain sections in two steps. To begin with, 
conduct transformation W, for X, that is, abandon the sections of X 
corresponding to B’, reserve those sections corresponding to A’ and, furthermore, 
move them to the left, and link them up so that X’ is obtained. In this process 
of shift, c*, 8, become 7,,f,. Then apply transformation Wa to X’, that is, 
abandon the sections of X ’ corresponding to B= Oa Ge Ba), reserve those 
sections corresponding to A = 5 E N, and, moreover, translate them 
to the left, and connect them up so that we have X. 


Proof of Lemma 3. From (4) we have G6= L{A) < LA’) =ë". If a, < a, by using 
(iii) and (v) in Lemma 1 we have aeAc A4’,a,€A’, whence t = L{AN[0,a,)} < 
L{A' A [0,a,)} < L{A'o[0, a)} =. 

There exists an inconsistency between them. Therefore a’ < g. 

Obviously, {7, 8} is a pair for X’. Suppose W; p(X’) = X = {3(t),t < 6}. Then 


G,, -> Gh = È L{A'O LB, ,Ty)) -ileo Ù Lho) 


By (4), 6, = Lt}. Ebr- 1T) } =o, whence ¢ =4. In order to prove X = X, 
it only remains to prove that X(t) = x(t), while telē, n1) = [0% 5,41), Le. 


¥'(B, +t- õa) = xl, + t0) (7) 
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Put u=f,+t—-G, (<a). In order to prove (7), we need only to prove 
Ba +t— 6, = 2%, By (v) in Lemma 1, we need only prove 


LIA A[0. By +t- 0)} = ntt- 8n 
Bai- O,EA' 
Since 0 <t — 0, < Ona — On = Ta+1 — Ên then B, +t—G,€[ Bm Tn) CASA. 
Moreover 
L{A'O[0, By +f — 0n) } = LLA ALO, Bp} + LAA OLB Ba tio) 
= Bi, + L{LBu By +t— On)} = Bu tt — On = Ba tt Fr 


which proves (8), and the proof is completed. | QED 


(8) 


Lemma 4. Suppose that the function X = {x(t), t < g} satisfies the condition in 
Theorem 3.1. Moreover, | 


A= U U (Bette) (9) 
n=1k=0 
y(u) = L{AF[0, u)} and the expressions C(A}, C,(A), Cj (A) are determined by 
(3.1)-(3.3}. Then 


(i) The conclusion (i) in Theorem 3.1 holds. 
{ii} C (4)c Ac CA) < Ci (A) c [9 6) (10) 


L{C,(A)} = L{A} = L{C,(A)} = L{C3(4)} = 6 (11) 
(iii) (a) y(u} is non-decreasing on [0, c). 

(b) If [a, b) 1C(A) = Ø, then for ue[a,b), we have y(u) = y(a). | . 

(c) If ueC}(A} and u<s<o, then y(u} < 3(s). Especially yu) is strictly 
increasing on C} (A). 

(d) For transformation y we have y[0, o) =[0,¢), ¢ = L(A). 

(e) y as a transformation from C ; (A) onto [0, 5) = y[C 7 (A) ] is one-to-one. 
Therefore, it has the inverse transformation y` | Furthermore, y and 
y | are measure-preserving transformations. Particularly, if [A, q)e@(A), 
te[y{2). y(n)), then 


y= A+ t yà) (12) 

(iv) As n-> œ there exist limits 
o” = L{A")t 6 = L(A) (13) 
a" (t=y (e) te[0,c) (14) 


Proof. By conclusion (ii) in Lemma 3, follows (i) in this lemma. Inclusions (10) 


RR TNR = th A STRAT ERR REDE, TTI A RMT SEEN ESF 
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are obvious. It is easily shown that %(A) is a denumrable set, therefore, sets 
C,(A), A, C,(A) are different from each other by one countable set at most. Thus, 
the first two equalities in (11) are proved. 

(iii) (a), (b), (d) in this emma are obvious. In order to prove (iti) (c), first notice 
that if te C(A), t < s <a, then y(t) < y(s). Therefore, for ueC} (A), u < s <a, there 
exists t „€C (A), t, Ļu. Hence we have u < t, <s < g, for sufficiently large n. From 
(iii) (a) and what was mentioned just now, we have y(u) < y(t,) < p(s). Thus {iii) 
(c) in this lemma is proved. 

We now proceed to prove (iii) (d). By (iii) (c), y is a one-to-one transformation 
from Ci(A) onto y(C}(A)) so that y7! exists. In order to prove 
‘measure-preservation, we assume £ to be the collection of Lebesgue sets F 
satisfying F c C} (A) and L{,{F)} = L{F}. Put € = {[a, b)j[a,b) = CZ (A)}. It is 
easily found that .2 is a d-system, € is a z-system, and € c Z, whence S 
contains all Borel sets in C H (A); see Dynkin (1959, Lemma 1.1). Consequently, 
F contains all Lebesgue-measurable sets in C 3 (A). 

From conclusion (i) in Lemma 3, it follows that the limits in (13) and (14) 
exist. For te[0, g), when n is sufficiently large, we have te[0, 0”). By conclusion 
(v} in Lemma 1, we have 


L{A"M{0,a")} =t ante A” (15) 

Since A” c A c C(A), letting noo, we find that the limit a, = lim,- o% 
satisfies 

y(a,) = L{AN[0,2,)} =1 a,€C3(A) (16) 


Noticing (10) and (11), we know that a, is a solution of (3.13). By (iii) (c) in this 

lemma, g, is a unique solution, and y~ (£) is a solution, too. Whence a, = y~ !(t), 

Cf (A)) = [0,6) and L{CJ(A)} = L{y(Cj(A))} = č. The proof is terminated. 
QED 


Proof of Theorem 3.1. From the right-continuity of X, and (13) and (14), (3.11) 
and (3.12) can be proved, and hence by Lemma 4, conclusions (i) and (ti) in 
Theorem 3.1 can be verified. We are now going to prove conclusion (iii) in 
Theorem 3.1. Let re[0, g) and slt. From (iii) (c) and (el in Lemma 4, we have 
y ‘(s)]. Let the limit be u. By (3.13), we know 


L{CAA)NTO,y "(9))}=s 7 ‘(s)eC2(4) 


Putting s |t, we find that u satisfies (3.13); therefore u = y~*{t), Le. y s) ly 0). 
Consequently, 


lim x(s) = lim x(a.) = lim x(y7 (5) = x(y -1()) = x(a) = 0) 


st sli sįt 


and the proof is concluded. QED 
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9.5 SEVERAL LEMMAS 


Let X = {x(1),1 < o}e.#,, B be a Markov time relative to X. .F g denote the pre-p 
field and F, denote the post- field. Set 


x(t) = x(f + 8) t<o,=0—f (1) 


We call X} = {x,(t),t <4}, or more simply X’ the post-f process. Let symbols 
LB), or simply ¥?, denote the complete Borel field which is on Q, =(f <a) 
and is generated by {x,(u),u<t}, £2(p) =F; 

Obviously, if t < $ are two Markov times relative to X, then 


F Os ZT Fe F' D F (2) 


t 


Lemma l. Let £ be a Markov time relative to X. Then 
OF? = LBC FOF gs, z (3) 
Proof. Let Ac.F°. By Dynkin (1959, Lemma 1.5), there exist t,€[0, t], and a 
Borel set I in EP = Ex Ex Ex --- such that 
A = {[x(t,), x(t}... JEF} (4) 


Therefore by Dynkin (1963, p. 122). 
Oh = {Lx pti), xp(o),-.- Jel fe LPA) (5) 


Hence we obtain 0,7? c ¥)(f). Similarly it can be proved that the inverse 
inclusion holds. Consequently 0,4? = Zp). 

Obviously, LP) Fy Now we need to prove that {x(s)=i}eF,,, 
(s<t,ieF), that is, for arbitrary u > 0, s < t, we have 


{x(B+s)=i 


When u <t, the left is empty. We can reasonably assume u > t. Set 


Btt<u<oleF? 


BD 站 rt ear or 


We have P{x(f,+s)= œ} = 0 by (7.6.1). From the right-continuity of X and 
(B+t<u}c(f, +1 <u), it follows that 


Bt I= teu o} = im pet) =if<u-tucoler? 


于 一 O 
and the proof is completed. QED 


Lemma 2. Let t and f be two Markov times relative to X. Then @,t is a Markov 
time relative to X% 


RE eee apanaman var er menne p e 
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Proof. 


(Opt <u} = |] {8t <u} oB =)= LU Olt <wa(p= t) =t <u) 


120 t20 
Since (t < u)e. F}, we have (Opt < ule ¥°, by Lemma 1, and hence (Ost <u < ape 
pe. QED 


Lemma 3. Let tt 有 be a canonical pair for X. Then t, and f, are Markov 
times relative to X. For a fixed n, set 


To = fo =0 T= taf, 


Then {t’, 8} is a canonical pair for X% 


Br = Bask Pn k> l (6) 


Proof. It is known that fo, t, and B, are Markov times relative to X. Assume 


that Th a are Markov times relative to X. By Lemmas 1 and 2 we have 


(Og T1 << ag JEL B,) TCF puti 


7 
(Og Bi <t < og )e LB) CF puti O) 


By Theorem 7.6.3, t+1= p+ Opt and Banti = Ên +058, are Markov times 
relative to X. 

According to Lemma 2, t4 =t)41—-6,=0%,t1, B'i =Br+1— Ên = 65,8, are 
Markov time relative to X} „ Moreover, 


bi + Op T1 = Basi = Êa + Opna - BrP pnt = Bati F Og. Ti = Bn = Baaz = Bn — T3 
In a similar manner, it can be shown that (3.17) holds for {t’, ’!, that is, {7', 8° 


is a canonical pair for X}. QED 


Lemma 4. Let {t, f} be a canonical pair for X. Then random variables o, and 
6, determined by (2.2) and (2.3) are ¥, and ¥, measurable, respectively. 


Proof. It is required to prove that for any u > 0, t > 0, we have 
(a, <Ut,<t<a)EF? 
(6, <u, B,<t<a)eF? 


In fact, let R denote the set of all rational numbers on [0, œ); then 
(p< <t <a) =} > a-hann <<a] 
k=1 


=U (tr Pr <io Te <t) (<<a) 
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and 
<p, <t<o)=| 3 (hn) <u, <io] 
k=Q 


(B,<t<a) 


一 U (By — Tk < fp By <t) 


TEER 
n 
ps ri<u 
k=1 


From Zhen-ting Hou and Qin-fen Guo (1978, Lemma 1.4.2) the above sets 
belong to F?’ and the proof is concluded. QED 


Lemma 5. Let {t, 8} be a canonical pair for X. x, is determined by (2.5). For 
each fixed t > 0, a, is a Markov time relative to X. 


Proof. Since t <a, <ø we may as well assume u >t. By Lemma 2 


2 À 
(a,<u<o)= |) (R-1)<u<t,a,<u<o)+ |] (r <u < Bua <u <0) 
k 


=1 


tC _ 8 


= 
ma 


= |) (Bp, <u<t,p(u)<u—tu<a)t+ |) (tSu < fuyu) >t, u <0) 
k=1 k=i 


iv 4) 


= () (6,1 <u—1B,-, KULU <T) + U (,>44,<u<o\u<f,): 
k=] 


k=i 


From Lemma 4 we know the above expression belongs to ¥°, and the proof 
is finished. QED 


Lemma 6. Let {t, 8} be a canonical pair for X. w is determined according to 
(2.5). If the condition {c} in Theorem 3.3 is satisfied, then the condition (b) in 
Theorem 3.3 holds. More precisely 


P{x(t)eE for all teA} = 1 (8} 

where A is just the same as in (4.1). In particular, 
P{x(a,eE for all te[O,a)}=1 (9) 
P{x(f,) = oo for some k} =0 (10) 


If the conditions (a) and (c) in Theorem 3.3 are satisfied, then for almost all 
weQ,, = (8, <a) and all ue[f,(), tr ,(@)], we have 
u + (8,7;)(@) = t+ 1(@) 


(11) 
u + (0 b10) = Pk 1 (0) 
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Proof. {a) First suppose P{f,=0} = 1. Put 
Ay 一 {x(uJeE for all uel, Tk+ 1)} MNO, 


By (3.17) and fo=0, it is evident that A, = 8p A 9. From the condition (c) in 
Theorem 3.3 and the strong Markov property, we have 


PIA, = Pi{0g,Ao} = 2, P{x(By) = k}P{Ag|x(0) = k} = 2, Pix(B1) = k} = PiQg,} 
g€ keE 
(12) 
Similarly, it can be proved that P{A = P{Q,, }. This verifies (8). 


Set 
A, = {u + Oot, = Tk+1 for all uel By, TK 4 1)} MN Op 


Similarly, we have A, = 6 Ao. From conditions (a) and (c) in Theorem 3.3 and 
the strong Markov property, and by following the discussion in (12), we can 
prove that P(A.) = P(Q,,), which verifies the first formula in (11). The second 
formula can be proved in similar way. 
(b) Suppose P {85 = 0} < 1. In this case consider the post-f, process X’ = X’ ; 
By Lemma 2, {t’, f’} is a canonical pair for X’, where 


tT) = fy =0 T= t bo Bi = Bi — Bo i> (13) 


Since X and {t,£} satisfy the conditions (a) and (c) in Theorem 3.3, so do X’ 
and {T B’}. By (a) it follows that the conclusions in this lemma hold for X’ and 
{t’, 8}. On the other hand, from (13), we have 


{x'(QeE for all teA’} = {x(t)eE for all te A} 


So 277 = O4,u+ 6,0, = t,,, forall ue[B,, t,, ,)} is equivalent to u + GT) = Tray 
for all ue[ bi, t+ 1). Therefore, the conclusions in this lemma hold for X and ft, Bt 
and the proof is terminated. QED 


Lemma 7. Let {1,8} be a canonical pair for X, P{fo = 0} = 1. The conditions 
(a) and (c) in Theorem 3.3 are satisfied. Then for any fixed s,t >0, we have 


Asti = Hs + (0) (14) 
Proof. Put X’ = X}, By Lemma 2 
By =0 Ti = baT: B'i = 6,8) (15) 


are Markov times relative to X’, so that we can determine the canonical pair 
{t’, B'} for X’ and the corresponding a, Since P{Bo = 0} = 1, it is evident that 
a, = O, (a,). 

From (v) in Lemma |, xse4 = (eof Buth +1). To be specific, we assume 
a,€[8,,% +1). By Lemma 6, os + 8p Ti = tha 15% + b 8, = By +1. Hence from (15) 
it follows that T) = 1,41, — a, BY = Bra, — %. Following the proof of Lemma 3, 
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we have 
T) = Thay 一 0 Bi = Bears (16) 


By Lemma | (v) æ; = 0, dade A = |] Zo {hr} 

To be specific, now we assume xe[ 8; ti). By (16), that is, Bp +1 — a, S 0, (2%) < 
T,+1— 4, Hence, Pps: ot+ 8 (0) < Than that is, a, +0, (a)e A. Furthermore, 
by (v) in Lemma 1 


t= L{A'n[0,ai)} 


-dU [An 14 ODO, a | 


oD 
=1} U [kti —% Tea 


— 4) [0, BaD] 


T dd U [Brats tt) [Zs Cs + oo 
1=0 


=LI An[z. a, + 6,,(a,))} 


Therefore, L{AN[0, a, + 8,0%) } = L{AN[0, «,)} +t=s+t. Consequently, 
a, + 0, {a,) is the solution of the equation 
yuy=stt ueA 


But «,,, is the unique solution of the above equation. Hence (14) holds, and 
the proof is terminated. QED 


9.6 PROOF OF THE STRONG LIMIT THEOREM 


Proof of Theorem 3.3. (a) Suppose P{8, =0} = 1. Assume t; <t} < 
isis, csin} EE. By Lemma 5.5 and 5.1, and by (5.2), we have 
n— 1l 
A, =f) {xia =i} ol, < 0)EF 
k=1 
A,= (x(a, = inet feos. 


From Lemma 7 and the strong Markov property, we obtain 


= < tata 


Ys 


P{x(a,,, ) =in44 [x(a J= i, 1 <k<n} =P{x(%,,,)=i+1lA, a, <9, x(a, )= in} 
P {x[a,, + 0, (%,, 1 th) = bat 1 | x{a,,) T in} 
= P{x(%,, 1 eta) = n+ 1 | x(Q) = i,} 
Noticing (3.19), we could prove that X = 
process. 
(b) Suppose P{Bo=0} <1. Now we consider X’ = X7,, its canonical pair 
{t B'} determined by (5.6) with n=0 and the corresponding %. Then (5.13) 


W, s(X) is a homogeneous Markov 
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holds and, moreover, 


a = a, — fo x' (a!) = x(a) (1) 
Since the conditions (a} and (b) in Theorem 3.3 are satisfied for X and se B}, 
they are satisfied for X and {1’, B’}, too. Consequently si to oY p(X) 


possesses the homogeneous Markov property. But W,,(X)= AX ’). 
Therefore X = W, .g(X) possesses the homogeneous Markov T 

(c) Since Xex., we have Xe. By Lemma 6, we know that the condition 
(c) in Theorem 3.3 implies the condition (b), and hence we prove the conclusion 
(iii) in Theorem 3.3. The proof is concluded. QED 


Proof of Theorem 3.4. Except that it remains to prove that X in Theorem 3.4 
is a process, the rest of the conclusions of Theorem 3.4 may all be deduced from 
Theorems 3.1 and 3.3. 

Let us now prove P{x(t}= œ} =0 (t > 0). 

By Lemma 6, for almost all œ, x(t, w}eE for all te A"(w), so that 


x(t, MEE for all te A(w) 


Therefore, by (iii) {e} in Lemma 4.4, when tey[C,(A(@))], y DEC Alo] < 
A(w). From {2), we get x(t,w)=x(y~'(t),w)eE. Consequently if we set 
S(w) = {t}X(t, w) =i} (ie E), then 

EC (A())] < {t]x(t, weE} = (J Sw) (So) VS.) = [0, ilo) 


icE ieE 
By (ii) in Lemma 4.4 (œ) = L{y[C1(A(w))]}, hence L{S,,(w)} = 0. By Fubini’s 
theorem it follows that there exists a null Lebesgue-measurable set T such that 
P{x(t) = 00} =0 when té€T. 

From (3.22), 66 inf, Bo =a, so that (3.21) becomes P{x(0)= oo =0. 
Therefore O€T. 

Now let us assume toET. Clearly to >0. Since L(T)=0, we may choose 
0<1t<t, such that both to —t and t¢T. Notice that for each weQ, we have 
lim, X"(t) = lim, œ x(a") = x(a) in E. Accordingly we set D = E — D for a finite 
set D c E. It follows that 


P{ž(to)eD} = P| lim x(a? Je 可 - lim P{x(af }eD} 


n> æ n> a 


Write X’ = Xp, 0, = af — Po From (t) Lemma7 and the strong Markov 
property for X’, we obtain 
P {x(a ED} = P{x'(a,,)eD} = P {x [a + 0,(a,,_,)]eD} 
= E {Poe lx (a, to 一 JeD]} 
= E{ Pantxtat,_,JeD]} 
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Therefore, P{X(tg)¢D} = limp, E{P...,[ x(a" _,)eD]}}. Since teT, we have 
: 6 3 t a t 
x(x,, WEE for almost all œ. As a result, when n is sufficiently large, we have 
x(x’, w) = x(x, w). Hence 


P{ž(to)eD} = El lim Pastre -0eD] | 


= E{P [x(% 1)eD]) 
= ¥ P{x(a,) = k} P,{x(a,,-,)eD} 
keE 
Letting D ÎE, we obtain | 
P{x(to} = 00} = }, P{x(a,) =k} P, {x(%, 7) = 0} 


kek 


Since P{ x(t)= co} = P{x"(t)= œ} =0 (t > 0), by Lemma 5.3, we know that 
as n> 00, {x"(t,)=i,, 1 <k <l} converges to {x(t,)=i,,1<k </} in distri- 
bution. Hence from the homogeneous Markov property for X, we obtain the 
same property for X. The proof is completed. QED 


9.7 SEVERAL KINDS OF SPECIAL STRONG LIMIT THEOREMS 


Theorem 1. Let XeX p. We fix a state ic E. Let By be a Markov time relative 
to X, satisfying P{ By <a} > 0. Set 


t, =inf {t|By <t <0, x(t)=i} 
B, = inf {tit <<a, x(t)#i} 
T+, = inf {t|B, <t<o,x(t)=i} 


We set inf Ø =o, Ø being an empty set. Then X = W, ,(X)e Hp, and X does 
not take the value i. 


Proof. Evidently {t, $} is a canonical pair, and the condition (a) in Theorem 3.3 
is satisfied. Since Xe p, the condition (b) in the same theorem is, of course, 
satisfied. Hence by quoting Theorem 3.3 we obtain Theorem 1. QED 


Theorem 2. Let XE Hp, and the subsets M and N of E be disjoint. Put 
Bo = inf {t}0<t<a,x(theN} 
tı = inf {t|B, <t<o,x(t}eM} 
B, = inf {t|t, <t<o,x(t)eN} 
Ta+1 = inf (|B, <t<a,x(r)eM} 
Then X = W, .(X)e%p, and the value of X belongs to E— M. 
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Proof. It is the same as Theorem 1. QED 


Theorem 3. Let XEH,, and finite sets D, TE. Put 
Bo = inf {t|0 <t<o,x(t}eD,! 
ti = inf {t| Bi <t<o, x(t)¢D,} 
By = inf {tjt} <t <a, x(t}eD,} 
Tha, =inf {tp <t<o,x(t}¢D,} 


Then X” = Wn 4,(X) is a minimal process, whose state space is D,, and 
lim X" = X. (i) 


Proof. Referring to Theorem 3.4, we easily see that {t”, 8"} is a canonical pair 
for X, and the conditions (a) and (c) in Theorem 3.3 hold for X and {7",p"}. 
Since P{x(0)= œ} =0, it follows that inf," = 0, so that (3.21) holds. As D,T, 
(3.22) holds, too. 


Notice 
x(NeD, ifteA"= |) [Bt tis) 
k=0 
x(Ð£D, if teB, = |) Lr, pr) (2) 
k=0 


By (1) in Theorem 3.4, we obtain X" = W,, p(X )EXW p. By the definition of X”, 
we know that X” does not have any leaping point, hence X" is a minimal process. 
Let us now proceed to prove 


{t}x(tjeE} = A= |] A" (3) 


Assume x(t) = ie E; then there exists a number n such that ieD,, and therefore 
x(t)eD,, By (2), we get te4” c A. Hence {t|x(t)eE} < A. On account of (2), the 
inverse inclusion relation holds too. 


By (3), [0c) and A are differ by a nuil Lebesgue-measurable set 
So = {t|x{t) = 00}. So we have 


y(u) = L{AN[0,u)} = L{[0,6)0[0,u)} =u 
Therefore, a, = y` ‘{t) = t, E =o. Consequently, (3.14) becomes (1). The proof is 
completed. QED 


Theorem 4. Let Xe, be a non-minimal process and finite sets D,ÎE. Put 
Bo =0, 
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t? being the first leaping point for X 

pt = inf {t|ti<t<o,x(t)eD,} (4) 
,| being the first leaping point for X after fi 

Then X” = Wn p(X EX, (collection of all first-order processes), (3.10) holds 
and, moreover, (1) is still valid. 


Proof. Following the proof of Theorem 3 and quoting Theorem 3.4 we need 
only explain that, in the present case, (3) still] holds. For this, let us notice that 


x(t}ekE for all te A” (5) 
x(H¢€D, for all te B" 
And following the proof of Theorem 3, we know that (3) holds. - QED 


Remark 


The transformation X to X" in Theorem 4 is just the transformation Jn- 
Theorem 4 is precisely the fundamental result in Zhen-ting Hou (1975), i.e. the 


first construction theorem in Zhen-ting Hou and Qin-fen Guo (1978). 


CHAPTER 10 


Leaping Interval and Entrance 
Decomposition 


10.1 INTRODUCTION 


In this chapter we study the entrance of a process. We have introduced the 
concept of leaping interval, namely, U interval, and studied the relation between 
leaping intervals and set of leaping points, and we have found the necessary 
and sufficient condition which is expressed by leaping intervals and under which 
the Kolmogorov equations hold. We have found that it is effective to apply 
leaping intervals to the study of the entrance of a process. Especially, we have 
derived the entrance decomposition theorem of a process. Making use of this 
decomposition, we can investigate distinct entraa¢es independently in the case 
that various kinds of entrances present themselves. By using the results of leaping 
intervals, we have obtained two kinds of strong limit theorems of a process, 
that is, transformations yg, and mfa, and the strong limit theorems 
corresponding to them. As a simple deduction of these theorems, they are 
precisely the basic results in Zheng-ting Hou (1975), namely, the first 


- construction theorem in Zheng-ting Hou (1974) and Theorem 5.3 in Zi-kun 


Wang (1962). 


10.2 DEFINITION OF LEAPING INTERVAL 


Suppose X = {x(t}, t <olew,. Owing to (7.6.1), without loss of generality, we 
shali suppose henceforth for every wel, 


x(r, weE for all reRO[0, olw)) 
Hereafter, R represents the set of rational numbers in [0, c0). 
Definition 1. A point te(0,o(w)) is called a continuity point of X(w) if 
lim, x(S, ©) = x(t,w)EE. The set of continuity points is written as G(«). 
D(w) = [0, (w)] — G(w) is called the set of discontinuity points of X(c). 


Recall Definition 7.8.1, denote the set of jumping points of X(w) by T(a), 
and denote the set of leaping points by P(w). We appoint 0e T(w) oT (w), but 
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call ! = 0 the zeroth jumping point and zeroth leaping point. X(c) has the first 
discontinuity point t,(@) > 0, and the first leaping point t(w) > t,(w) > 0. 
Obviously, if a(w)<oo and oa(weT(w), then x{o(w)—0, w)eH (non- 
conservative state set). It can be easily seen that D{w)and F (w) are closed sets. 
For every se{0,o(w)), we can define 


p(o) = max { D(w) Vn [0,5] }, 

v (œ) = min { D(w) [s, ¢() ] } 
Aw) = max { F(a} [0,5] } 
ndo) = min{ Tow) a Ls, o(w)]} 


For a = 0, define 
Vo(@) = T,(w) noo) = tw) Hoo) = 0 Ao(w) = 0 (2) 


For s>0, cali p(w), A,(@), v,(@), 4,(@) respectively the last discontinuity point 
before s, the last leaping point before s, the first discontinuity point after s, and 
the first leaping point after s. Suppose s > 0. If se D(w) or seTl(w), then obviously 
t(wo)=v(wy=s or A(w)=ylw)=s. If sD) or srw), then we have 
(wm) <s < rdw) or 1(w)<s < ndo). 


Definition 2. Call {4,4} a leaping interval, namely, U interval, of X(q) if 
À nerio), and (4,n)AT(w) = @ (empty set). The collection of U intervals of 
X{w) is written as @(w). 

It is quite plain that U intervals in @(w) have the order of ‘before’ and ‘after’ 
according to its place in [0,4] 

From Zi-kun Wang (1965a, Theorem 3.2.4, corollary) we know that if [A, 7] 
is a U interval, then the discontinuity points in (4,4) are jumping points and, 
moreover, 


x(t, wjeE for all te(å, n) (3) 


Definition 3. suppose [2,n)eW%(o), M c Ë, N c E. H x(A,w)eM, call [A,4) a mU 
interval. If x(y — 0, œ)e N, cali [A, 4) a Uy interval. Similarly, we can define Uy 
interval, ;U interval, etc. Write the collection of U intervals of X(@) as m (œ). 
Similar notations are Yy(@), (œw), etc., whose meanings are clear. 

By Theorem 7.7.2, X(@) has no Ug_n interval; in other words, if X(q) has a 
Us interval, it must be a U y interval. 


By Zi-kun Wang (1965a, Theorem 3.2.3), for any fixed + >0 for almost all - 


we(t <a) we have 
Alw) < plo) < t < vo) < ndo) | (4) 
thus we know easily that for almost all weQ 


Al) <r <n, (o) for all re R O[0, a(@)) (5) 
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{[A(@), 1,(w))\reR A [0, alo) y} = U) (6) 
Hence (w) is a denumerable set. 
Write 
Uo) = {LA MITA, nEw) 4 > (a) }. (7) 
Similar notations are y% (œw), WY (wm), etc, whose meanings are clear. Write 
C(o)= U Bn (8) 
[4 me to) 
C= U Amn (9) 
LA,me¥(w) 


Similar notations are yC,(w), C’,(@), etc., whose meanings are clear. 


10.3 LEAPING POINT AND LEAPING INTERVAL 


Definition 1. Suppose teF(w). Call t a right isolated leaping point of X(w) if 
there exists é > 0 such that (t,t + ¢} ^T (œ) = @. The set of all the right isolated 
leaping points is written as I’’(w). Similarly we define the set T'(%w) of left isolated 
leaping points. 
For M cE, let 
rlo) = {tlteT'(w), x(t, weM} (1) 
Fy (œ) = {t|there exist non-increasing t,e% (wj, such that hd D 
Furthermore, call yy the right closure of T4 {cw). Similarly, let 
Ui (w) = {tlteT (wo), x(t — 0, w)eM} (3) 
and the left closure 
I'l, (w) = {tithere exist non-decreasing tel ido), such that t,t} (4) 
Obviously, OeT (wo) AI"(a). If a(@) < oo then o(w)eT"(a). 


Theorem 1. For almost all weQ, 
P(e) = {| (A, nheW(w)} {0} (5) 
ro) = {Al TA, mevo u {a(w)|o(a) < co } (6) 


Proof . It suffices to prove (6). It is obvious that the right-hand set is included 
in I’(w). Suppose teI"(w) and t # olw). By the definition, there exists £ > 0 such 
that (t,t+aNT(w)= g, and therefore taking arbitrarily reft, t +9AR, 
t = À (w) <r <n,(w). By (2.6) we know t belongs to the right-hand set in (6), and 
the proof is completed. QED 
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Theorem 2. For almost all œ, 


P(e) = +w) = F (en) (7) 


Proof. T'*(w)< Flo} is obvious. Suppose terto). If t=0 or t = a(m), then 
obviously 1eT(w) c F'* (ew). If te(0, o()) and t¢T"(w), take arbitrarily strictly 
decreasing ralt, r,€RO[0,o(«)). By the definition of 4,(@) we have 
tS Anl) <r, Since trw) it follows that t < 2, (w) <r, Consequently there 
exists a subsequence r, of r, such that A,(w) strictly decreases. When r’ $t, 
À, (w)}t. By Theorem 1, A,(@)eP"(w). Hence tel*(@). Therefore P(w) = i+ (9). 
Similarly we can prove TF(w) = TF (w), and the proof is concluded. QED 


Theorem 3. For almost all weQ, 


Spl) = C (wv {hieT'(w), (4, EE} c Co) (8) 
[0, a(o) — Cw) < Salo) = Fo) (9) 
L{C loh = L{C,(w@)} = a(o) (10) 
where : 
Sylw) = {t|te[0, a(w)), x(t, o)eM} MCE (11) 


Proof. The inclusion relation in (8) is clear. S,,(@) CT(w) is also clear. Suppose 
teS,(w)}, then there must exist ic E, such that t belongs to some i-interval [a, b) 
of X(w). We take arbitrarily re{a,b)AR. Then te[a,b) c [A,(w),4,(~)). Now, 
either re(A,(w), 4,(w)) = Cy(@) or t = Awer" w), and x(t, œw) = ic E. Accordingly 
Selo) EC (WU {Aler w), x(A, WeE}. The inverse inclusion relation is clear. 
Thus (8) is proved and hence so is (9). Because [0, o{w)}} = S,(w)US,,(w) and 
LIS .(w}$} = 0, from (8) and (9), follows (10). The proof is terminated QED 


Corollary 
LiT o) = 0. 


Proof. Because T(w) c [0, o(w)) ~ C,(@), by (10) we obtain L{T{w)} = 0. QED 


Let 
Alw) = Sdo) — Tw) ~ [0, elw) — Tlw) i (12) 


U(A(@)] represents the whole of the composition interval in A{w). 


Theorem 4. For almost all weQ, 
HW Alo] = Uw) (13) 


Proof. Suppose [A,#)E@[A(@)]. By definition, (å, n) c Alw). Then by (12), 
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(A, 4) AT (a2) = @. Moreover taking arbitrarily te(4,y), we have x(t,w)eE, 
oo n(w)) = A(w). By the maximality of [2, n), [4,n) = [A(@), n(a))e 
Ww). 

Suppose [4, me(w). By definition, {4mo ro) = Ø. Noting (2.3) we have 
(A, 7) = Alw). [fit holds that [’, 9’) > [A, 7) and (à, 9’) < Alw), then 4 <1 < ney, 
and for any se(4’,7’) we have s¢T(w). Thus for any te(4,7) we have Aw) < 4’, 
1 <n{w). However, 4,neT{w), so that we also have å = A), 4 = (w). Thus 
A =À = Adwo). n =n=n(o). The maximality of [A,y) is proved. Thereby 
[A,7)€%[A(w)]}. The proof is completed. QED 


Theorem 5. Suppose M c E, N c E, and H is a non-conservative state set, Then 

all the following sets are F? -measurable sets: 

F, = {@|&q) has a last U interval and it is a Uy interval} 

F, = (@|U(o) = &(o)} 

F, = {wlthere is a last U interval in (w), and except for that last one, the 
remaining intervals in W(c) are all Uy intervals} 

F, = {0V (0) = 4X} 

F; = {wlthere is at most one U, interval in (w), and if there is one such, it 
is the last U interval} 

Fe= {wjthere is at least one U, interval in (w), and such a U u interval is 
not the last U interval} 


Proof. Obviously first, for r > 0, keE, 
(x(q, —0) = k}E F? (14) 
Secondly we proceed to prove 
{x(A,)=k}eF? (15) 
Actually, when k # oo, by (2.1), 


(i) =} = =k a <r=U) 及 i fx( mer! rab] Sar) Tio) 


il 
= 
= 

Il 
3 

il 
© 


. l — l 1 
is a finite set, Ee can T(@) is an infinite set le? 
{x(A,) = co} =(r<o)—U {@)=k}eF? 


keE 
It follows that 


F,=(){r<o,4, =0,x(q,~O)EN}eF®, 
reR 


F= A {(o <rjul(r<oa,x(n, ~EN) EF? 


262 LEAPING INTERVAL AND ENTRANCE DECOMPOSITION 


F, = A {o <rnul(r< FH, = anur< O,4,< 36, x(n, — EN) EFS, 
reR 


F= N fle srnulr< rul sr <o, x EM)} EF., 


reR 
Fs = Q 本 FEF? 
Fe 二 J {n <6, x(n, T O)eH} EFS, 


reR 


The proof is over. QED 


10.4 LEAPING INTERVAL AND KOLMOGOROV EQUATIONS 
Suppose M cE, N c Ẹ, Sc E. Let 


čus =inf{t|t<t<o,x(AJeM, x(tes) (1) 
psn = Sup {t0 < t <o,x(t)eS, t(n, 一 DeN} (2) 
6s=inf{tlt <t<o,teF, x(tjes} (3) 


Here 7 is the first leaping point of X and T the set of leaping points. For empty 
set Ø, set inf Ø =o and sup Ø =Q. 


Lemma !. Suppose S is a finite set, then the ‘inf’ in (1) and (3) can be replaced 
by ‘min’, l 


Proof. Suppose tl Čus, T Et, <0, x(A,, JEM, x(t,)ES. Since 9 is finite, by the 
right-continuity property of X, 

avi 
Therefore čys belongs to some i (eS) interval [a, b). When n is large enough, 
t eLa, b}. Thus x(čms) = x(t,), Aeus = A, Hence x(4z,,,) = x(4,,)eM. So we have 


tn 


proved that ‘inf’ in (1) can be replaced by ‘min’. The remaining proof is similar, 


and the proof is terminated. QED 
Lemma 2. 
Sus = inf { Saejl JES} = inf {ésikeM} = inf {¢,;|keM, jes} (4) 
Psn = sup{psjljeN} = sup { pyylkeES} = sup (p,,|KeS, jeN} (5) 
ds = inf {6,|keS} (6) 
Proof. Let 
Ayus = {tlt St <a, x(d,JeM, x(teS} (7) 
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Obviously, Ay; Ays (jeS) so that Cmj = Sms (JES). On the other hand, for 
any € > 0, there exists te Ay. = 人 sa such that £ < čys + £. Thus there exists 
jeS such that te Aw; Hence SmiSt<Eys +e. So we have proved that 


Cus = inf {Ex_;| jeS}. The remainder can be proved similarly. The proof is 
concluded. QED 


Lemma 3. Čus, ôs are Markov times of X, and Psy is a random variable. 


Proof. By Lemma 2, it suffices to prove, for keE, JeE, that &,,5; are Markov 
times and p,; is a random variable. 
Actually, noting (3.15), for any u>0 


(Cuy <u <o)= |] {t<r<a,x(4)=k x(r)= ju<oleg? 
rR 


Secondly, 


(ô; < u < ô) = U flesr<aster= na] A Hek 


F<y 
reR 


TENE s . ae =] 
(x has infinitely many jumping points in E r, zr) 


| 3? 
and takes a constant value j in | r, 小 | 
Fm 


(P; >u)= |) {0 < a < 0, x(r) = k, x(n, —0) = jheF® 
reR 


and 


The proof is completed. QED 


Definition 1, Assume Xex, We cali X pure entrance from M, if 
P {U = yU} =1 (iE E); we call X pure exit to N, if P {U = Yy} = 1 (ie E), we 
call X quasi-exit to N, if P{Q,)= 1 (i€ E). Here 


OQ = (F,-F,UF, 
= {w|the last U interval does not exist in U(w) and, moreover, Yaw) = Y n(w)} 


U {w|there exists the last U interval in U{co), except for the last U interval, 
the others are all Uy intervals} 


F v Fz and F, are determined by Theorem 3.5. 


Theorem 4. Suppose Xe, then the following conclusions are equivalent to 
each other: 


(i) The process X is pure entrance from oo, that is, P{W" = 多 1] = 1 (ieE). 
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(ii) P; {Ene <0} =0 (IEE), Ex, is determined by (4.1). 
(iii) The process X satisfies the system of forward equations. 


(iv) For any t >0, Pift <t <0, xjEE =0 (ic E). H one of the above conclu- 


sions holds, then 
(v) Pi{čor = T} = 1 (ie £). More precisely, for any ieE, P; almost all we(t < ø), 
we have tw)el "(wm). 


Proof. Clearly, (i)=(iv). Conversely by (iv) we deduce P,{x(A,JeE for all 
re 及 [ro =0 (ieE). From this and noting (2.6) we obtain Pi{ =%}=0 
(ic E). This is just the condition (1). 

(i) (iii). Suppose t>0. Since P;{x(t)= œ} =0, thus for P; almost ali 
welt <c), we have teS,(w). By Theorem 3.3, teC,(w). Hence there exists 
[A, 4}€%(w) such that te[A, n). If [A, n} = [0, t(@)), then evidently there is the last 
discontinuity point p(w)e T(w), before t. Or else, by conclusion (i), [4,n) is a 
„U interval, x{A}= œ. Thus te(A,y) so that A<pfla)<4, ulw)eT(w). By 
Theorem 7.8.3, X satisfies the system of forward equations. 

(iii) => (ii). By Theorem 7.8.3, if conclusion (iii) holds, then p,(Q,)=1 (keE), 
where 


Q, = {w|for all reR N[0, o(~)), x(r, w)EE, u,(w)e T(w) } 


If we(é;; < o) (i, je E) then x(A,,,,@) =i. So that there exists re R 4 [0, o(@)) such 
that å; (w) and rare in the same i-interval; thus jiao) = Ag, to) T(@). Therefore 
wth, namely, (¢;;< oo) c Q-Q. Thus by Lemma 2, 
(Cex < 0) = J (j; <0)cQ-Q0, 
i jeE 

Conclusion (ii) is proved. . | 

(ii) => (i). H oY + U), then there exists pU interval [A, hew). Hence 
there exists some icE such that €,(w) < o{w). Consequently, 


(U UC Utes: <6) = (eg <9) 
Conclusion (i) is proved. 

(i)=>(v). By conclusion (i), for P, almost all œ, I(w)— {0} = 由 Moreover, 
by Theorem 3.2, if t(w) < o(w), then either t(q) is the left end-point of some U 
interval, and then x(t(@), w) = œ, tr(w)el {œ} or there exists strictly decreasing 
4 1t(w),4, being the left end-point of some U interval. By conclusion (i), 
x(A,,) = oo so that t(w)eT**(@), and the proof is concluded. QED 


Theorem 5. Suppose XE, then the following conclusions are equivalent to 
each other: i 


(i) The process X satisfies the system of backward equations. 
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(ii) The process is quasi-exit to oo. 

(iii) P,{@|@%(w) there is at most one U y interval in W(w); if there is one, it is 
the last U interval} = 1 (ie £). 

(iv) Pi{rieT(w), t, <a} =0 (ie H), where t, is the first jumping point, and H is 
the non-conservative state set. 


(v) For any 120, Pt <o,x(n,— OeH,n, < 0} =0 (ie E) 


Proof. (ii) and (iii) have the same meaning. 

(i}=> (ili). By Theorem 7.8.3 P,(Q,) = 1, where Q, = fœ] for all reR A (0, ctw), 
v (we T(@)}. By Theorem 7.7.2, P{Q,) = 1, where Q, = {| for allre R A[0, o(@)), 
if x(y,—0,@)eH and n(w) < olw), then x{n,,w) = oo}. We are going to prove 
2,90, c Fs. Actually, suppose weQ, OQ. If X(w) has a Uy interval [A, n), 
namely, x(n — 0, w)eH, then there exists re R A [0, o(w)) such that nw) = vw) = 
nov). Ifn(@) < o(w), since weQ, it follows that yœ) = v (we T(w). Because weQ, 
we have y =n,(w)eI(w). This is a contradiction. Therefore surely 7{w) = a(w), 
that is [4, y) is the last U interal. So we have proved Q, ^Q, c F, and, hence, 
we have derived conclusion (iii). 

(ii) => (iv) is obvious. By conclusion (iv) and the strong Markov property we 
obtain conclusion (v) easily. 

(v)=(i}. By conclusion (v) we have P;{Q,4} = 1 (ieE), where Q4 = {@| for any 
reERMLO, o(w)), if x(n, — 0, weH, then surely n4w) = o(w)}. 

Fixing t 20, because P;{x{t}=00}=0, by Theorem 3.3, for P; almost all 
we(t<a)AQ4, we have t < S,{w) c Clw). Thus there exists [4,4)eW%(w) such 
that te[4,y). If x(7—0,w)= œ, then A<it<v,(w)<y, so that v,(w)eT(@). 
Otherwise x(n —0,w)eH. If v,(w) <n, obviously v(w)e T(w). If ¥(q@) =, then 
there exists reR O[0, o(@)) such that 4 = vw) = vw} = 4{e). Since meQ,, it 
follows that n = o(w). Thus v,(w) = o(w)e T(w). Therefore there exists constantly 
vi(w)eT(w). By Theorem 7.8.3, X satisfies the system of backward equations, 
and the proof is terminated. QED 


By Theorems 4 and 5 we obtain the following two theorems immediately. 


Theorem 6. Suppose X¢#’,, then the following conclusions are equivalent to 
each other: 

(i) X satisfies the systems of backward and forward equations simultaneously. 
(ii) X makes its pure entrance from oo and quasi-exist to o. 
(iii) Pi{Ceg < o} = 0 (ie), Pifrierr <0} =0 (icH). 


(iv) PU = oK} = 1, P,{there is at most one U interval in %; if there is one, 
it is the last U interval} = 1 (ie E). 


(v) Pi{t<t<o,x(AJeE} =0 (t > 0,i€E) 


Pi{t <o,x(y, — OeH,n, <a} = 0 (t > O,ie E) 
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Theorem 7. Suppose Xe then the following conclusions are equivalent to 
each other: 


(i) X satisfies neither backward nor forward equations. 
(ii) There exist ieE, keH such that P{E,,<o}>0, P,{t,eI,t, <a} >0. 


(iii) There exist i, ke E such that P{w' = ,W"} > O and P, {there is a Up interval . 


in X, but it is not the last U interval} > 0. 
(iv) There exist t; > 0, t, 20, i,keE such that 


PAt<t,<o,x(4,,)EE} >0 Pit, <0, X(n, ~ OeH,n,<o}>0. 
Theorem 8. Suppose XeE#’,, MCE. Then the following conclusions are 
equivalent to each other: 


(i) The process X makes its pure entrance from M, that is 
PIW = yU} = 1(ieE) 
(ii) P{égp<o} =O(ieE, M = E — M) 


(iii) For any t >0, P;{t <t <0, x{å)eM} =0 (i€E)}. Or equivalently, for any 
i€ E, t > 0, for P; almost all we(t <t < o), we have x[4(w), ojeM. If one 
of the above conclusions holds, then 


üv) Piéu =t}=1 (i€E). More precisely, for any ieE, for P; almost all 
DoF tae y (œ). 


Proof. (i)=>(iii). This will be done by following the proof in Theorem 5 that (i) 
and (iv) are equivalent. 

(i)=> (ii). Suppose we(E gp <0) = [s(n <0). Then there exists some keE 
such that Se) < alw). So [4。 PA J Ne- @ z weU (ow), and by x[A, ik ),ojeM 
we know it is a gU interval so that we(W' + yU’). 

(ii}=> (i). By the homogeneity of X and the conclusion (ii) we e have for all 
reR, P0(Eg,<¢)}=0, 0 being the translation operator. Let Q= 
ert — O(Ege <o)}, then P(Qo) = 1. When weQo, for ail re{0, o(w)), there 
is no ,,U interval in [max (r, t(w)), o(@)), so that all the U intervals in [t(@), o(@)) 
are „U intervals, namely, Qg Cc (W = y’). 

Suppose one of the conclusions (i)-(iii} holds, then for P; almost all %, 
rlw) — {0} a an empty set, so that r(w)¢Iyy(w). By Theorem 3.2, 
tw)eT(w) = T * (a) = Ff (oj and the proof is completed. QED 


10.5 THE yg, TRANSFORMATION AND ITS STRONG LIMIT 
THEOREM 


Suppose X = {x(t),t<c}e#,, M cE, and finite sets D, 7 E. Let 
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mho =0 
at, be the first leaping point of X 
mPp = Min {tlut St <a, X(A,JeEM, X(t)e Dp) 
mt, DE the first leaping point after yf? 


(1) 


4, is the last leaping point before t. By Lemma 4.1, the ‘min’ in (1) exists, so 
long as the set after it is not empty, or else let it take value a. 

By Lemma 4.3, wt, ub are Markov times of X, and we can easily see that 
for every n, {wr mb"} is the canonical pair of X, and satisfies the conditions 
(a), {c) in Theorem 9.3.3. Thus by theorem 9.3.3, mx" = Wn gl X EH p. 
Actually, 4X"e",, that is, yX” is a first-order process. ~ 
Definition 1. The transformation Wo obtained by transforming X ei into 
MX "eX, in the same way as stated above is called the yg, transformation. 
When M = E, we simply write zg, as gp 

Thus, 


MX" = mgn(X) (2) 


Obviously, when nf oo, 


=U) CBE ute fwd4 
k=0 


=) Ge led (3) 


k=0 


Theorem 1. For almost all weQ we have 
Wy A5(o)] = yH) (4) 
Colm A(@)] = Col AY(@)] = uC lo) (5) 


where wA] = 4A, —(0,t), 4A'= 4A —[0,2), t is the first leaping point. Here 
U(A), C(A) are understood according to Definition 9.3.1 and MW), Elo) 
are understood according to Definition 2.3 and (2.8). 


Proof. Note first that according to the definition, for any tepB" = 
ie iLauty mBi), there must exist 


x(QED,, or x(HeED,, <A )EM (6} 
while for t < te,,A", there surely exists 
x(A, JEM {7) 


We proceed to prove (4) so that (5} follows from (4). 
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(a) Suppose [4.me¥ [yA {(@)]. Since (4,9) € yAj(o), andy Aj(w) aT (wm) = ©, 
it follows that (4,4) AT (w) = Ø. Therefore take arbitrarily te(2, n), and we have 
(4,.n,) > (A). If å, < å, then we can take arbitrarily se(4,,4). Since x(s,w)ek, 
there exists n such that x(s,w)eD, But 2,=4, since tefh,y)c yA\(w)c 
uA (@). So by (6) and (7), x(A,,@) = x(4,, @)eM, and moreover n, =n, > n. On 
account of (6), së B"(w), séyA%w). Namely, there exists !>1 such that 
SE[ wp"(w), utr, (0). Because ,= yr () 29, (8.9) € (MPO) tie {oe 
mA'(w). This contradicts the fact that [4, n) is a composite interval of 443 (%). 
Thus 7, =A. That 4, = can be proved similarly. Hence å, ner (w). 

Summing up what precedes we get [4,1)e mY (œ). 

(b} Suppose [4 mE w), that is, A> (0), Anel(o), (SDNTD) = Ø, 
x{A, mye M. 

Take arbitrarily se(à.n), then 4= 4, 7 = Y, and x(s,w)eE. Thus there exists 
n such that x(s,w)eD,, and x(A,, w) = x(4, œ)e M. By (6) and (7) we obtain s€,,A,, 
so that there exists 大 1 such that se[y Pile). yt, ,(@)), thus 47 = 4, = wk 
Hence (5,4) © (MBRO) ate (@)) = Ai). By the arbitrariness of s, (4,n) = 
nAi. 

Next, if [2,1) > [4,m, and (4,0) cE yA‘(w), then we can take arbitrarily 
te(A,n). Since A, eT (ew) it follows that À = A,, 4 =y, On the other hand, since 
(4'0) E mA (mw) and yA oTo) = O,so4,< 4, N SH, Thus A =A, 4’ =H. 
Namely, [4’, 7’) = [7,m. Thus we have proved the maximal property of [A, n). 

Summarizing what precedes, we obtain [A,n)€%[A\(@)], and the proof is 
completed. QED 


Remark 


Ul yA OY] = Ho) is not necessarily true. For instance, if X EW pœ then 
pAlw) = [0,a(0)), so VAO = [ohoo But Ww) = {Udy n= 
{,2,...}, 4, is the nth leaping point of X(w). 

On account of (3), according to Theorems 9.3.1 and 9.3.4, 


MX" = MIN XEH | (8) 
Mgm(mX") = MX” man | (9) 


Furthermore the strong limit of wy X" exists and it is just yX EX» namely, 


lim yX" = wvXEX. (10) 


n> D 
where 


MX = {x(a (0 t < yo} ud = Li yA} (11) 
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Here „y is the transformation determined by the sequence of pairs {,,t", Mp") 
(n > 1), that is, 


oyu) = L{yA (0, u}} ue[0, a) (12) 

By Theorem 1 and the conclusion (ii) of Lemma 9.4.4, 
mu) = LiCl Aloo FO, u)} = Lf yC(o) [O, u)} (13) 
mo = L{C[yA(@)]} = Lig C(o)} (14) 


By Lemma 9.4.4, the inverse transformation yy~' maps [0,40) onto 


CF (4A) = CZ (w). Thus we obtain the preceding part of the following theorem. 


Theorem 2. Suppose X €#,. Then (8)-(10) hold, and ,,X is the process making 
its pure entrance from M. If X satisfies the system of backward equations, then 
X", mX all satisfy the system of backward equations, and have the same Q 
matrix as X. 


Remark 


The intuitive meaning of ,,X is as follows. Reserve all the parts of Xwhich 
correspond to [0,t} and „U interval, abandon all the remaining parts,and 
translate the reserved parts towards the left in the original order, linking them 
up in a disjoint manner and, thus we obtain the process yX EX 


Proof. Because among the U intervals of ,,X, except for the first U interval 
[0, t(@)), the remainder are all „U intervals, „X makes its pure entrance from 
M. Quoting Theorem 4.5{iii) we derive the conclusion about equations in this 
theorem. As X, X”, mX have the same first leaping point t(w), their Q matrices 
are the same, and the proof is concluded. QED 


Corollary | 
Assume xe, and let P{ yU =U} = 1. Then 


lim 4X" =X (15) 


no 


Proof. This is quite obvious, for under the assumption of Corollary 1, yX = X. 
QED 


Especially, when M = E, the assumption in Corollary 1 is always satisfied. 
Thus we have 
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Corollary 2 


Suppose X eX Then 


lim X"= X | (16) 
where 
X" = g (X EX , (17) 


If X satisfies the system of backward equations, so does X”; furthermore X and 
X” have the same Q matrix. 

Corollary 2 is just Theorem 9.7.4, that is the basic result, in Ane -ting Hou 
(1974), namely the first construction theorem. 


10.6 ENTRANCE DECOMPOSITION OF A PROCESS 


Theorem 1. Suppose Xe X „ finite set M c E. If 
Pp{x(WeMiIit<ol=1 (1) 


where t is the first leaping point, then Xe}, that is, X is a one-order process. 
Especially when X makes its pure entrance from M, (1) holds, thus X is a 
one-order process. 


Proof. When X makes its pure entrance from M, all U intervals of X (except 
the first one) are ;,U intervals. Suppose t < o. By Theorem 3.2, tel c y. 
tel 4,, then x(t)e M, or else there exist strictly decreasing 4eL such that 4. n4t. 
But TUJEM: by the right-continuity of X and the ss of M, surely 
x(t) = lim x(4,)€M. Therefore it is always true that x(t)eM. Thus (1) is 
proved. 

By (1) and the strong Markov property of X we can obtain the first, second, 
third.... leaping points t',r?,r*,..., and moreover if t” < g, then x(t")eM. If 
for t < o(cv), X(w) has infinitely many leaping points in [0, 1], then in [0,1], X(w) 
takes values in M infinitely many times. Because M is finite, there exists ic M 


n> 


such that X{w) takes the value i inifnitely many times in [0,1]. Thus X (œ) has . 


infinitely many i-intervals in [0,1]. This contradicts Theorem 7.7.1. Consequently 
X has only finitely many leaping points in [0,1] (t <a). Therefore X is a 


first-order process, and the proof is completed. QED 
Theorem 2. Assume X ew,. For any icE, let 
这 = 人 xD E) t <a) (2) 


marn ee ey ry 一 一 -一 
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where ,C, is determined by (2.8), and 


jo = L{C2}, yu) = Li,C,0[0, u)} (3) 
iy * is the inverse transformation of ;y and it maps [0, ;0) onto iC}. Then: 
(i) For ie E, ;X €# , is the process making its pure entrance from i. If X satisfies 


the system of backward equations, then so does ,X; and what is more, X 
and ;iX have the same Q matrix. 


(ii) „X EX, is the process making its pure entrance from oo, satisfying the system 
of forward equations. „X and X have the same Q matrix. 


Proof. Letting M = {i} (ieE) in Theorem 5.2, noting Theorem ! and applying 
Theorems 4.4 and 4.5, we can derive the theorem. QED 
Remark 


For the intuitive meaning of Theorem 2 see the remark in Theorem 5.2. 


10.7 THE yf, TRANSFORMATION AND ITS STRONG 
LIMIT THEOREM 


Suppose XeH,, I is a set of leaping points, M c E and finite set D, 1 E. Let 


„Bo =0 
mt, be the first leaping point of X 
mB, = Min {t| yt? <t <o,tel, x(t}eD, nM} (1) 


Mik+1 be the first leaping point after yf" 


We can easily prove wir, yf" are Markov times of X, for every n, {yt", B"} 
is the canonical pair of X, and the conditions (a) and (c) in Theorem 9.3.3 are 
satisfied. Thus according to Theorem 9.3.3, 4X" = „rE o Actually 
MuX"ex | and is a one-order process. 


MT”, 


Definition 1. The transformation W oe m" obtained by transforming Xe#, to 
aX" according to the above method j is called the „f, transformation. When 
M = E, we simply write sf, as f,. Thus 


uX" = mf(X) (2) 


Obviously, when 
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一 一 a) — — 
MA’ = J Labi Mir+1i)f yA 
k=0 
= (3) 
MA‘ = 5 (大 ,wikiTwdi 
k=0 
Following Theorem 5.1, we can prove: 


Theorem 1. For almost all weQ, 

UA) 一 wa  “ (4) 
Co[yAo)] = C[yA‘(@)] =, mC ,(o) (5) 
where yA‘ = 4A, — (0,1), mA' = yA — (0,7), all the Y-quality and the C-quality 

are still to be understood by Definitions 9.3.1 and 2.3 and (2.8). 

As a result of (3), according to Theorems 9.3.1 and 9.3.4, 

UX" = uf AEF, (6) 
oS nla X") = yX" m<n l (7) 


The strong limit process of mw X" exists, and by (4) and (5), the strong limit 
process is just the process XE, in Theorem 5.2. Applying Theorem 4.5(iii) 
we derive the following theorem. 


Theorem 2. Suppose Xe,, then (6) and (7) hold, and 


lim pX" = uX EH, (8) 


n> ow 


If X satisfies the system of backward equations, then so do 4X" and 4X; 
moreover X, mX", yX have the same Q matrix. 


Corollary | 
Suppose Xe H,. If P{ yU =U} = 1, then 


n> 


Corollary 2 


Assume X €#,. If Pfs = U} = 1, that is it is impossible for the process X to 


make its entrance from infinity, then 


lim X"=X (10) 


n>% 


{oe eo ere Nee 


nate RIG IME MEU AS OT MT a Te a 


ee ee ee 


pe Te 


ret eer PEPE: TS PERTH PTI PE TY PI MYATT eR TSR PN HT STUY PIR IRR ET RANT ia 
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where X "= f(X )e |. If X satisfies the system of backward equations, then so 
does X, and it has the same Q matrix as X. 


Remark 


When X is a birth—-death process, Corollary 2 is precisely the case considered in 
Zi-kun Wang (1962, Theorem 5.3) when S = œ. 


CHAPTER 11 


Extension of Processes 


1t.1 INTRODUCTION 


The construction problem of processes is basically an. extension one. If the 
minimal Q process is a stopping process, constructiom of all Q processes is 
equivalent to that of an extension process of the minimai process, such that the 
extension process has the same Q matrix as the minimal process. When Q is 
conservative, Doob (1945) introduces for the first time extension processes of 
the minimal Q process, i.e. the so-called Doob processes. Chung (1967) provides 
a strict proof for Doob’s construction. For conservative Q, under some 
restrictions on processes, Xiang-qun Yang (1966a) and Kunita (1962) take into 
account extensions which are more general than Doob processes. 

In this chapter we impose no restriction on Q processes or instantaneous- 
return processes of order k. For example, we do not require the conservativeness 
of Q or the existence of ‘a centre’ and so on. Furthermore, we even do not 
require the finiteness of the Q matrix in section 11.2. 

We mainly consider non-sticky extension. Because the D-type extension may 
change Q matrices, we introduce the D*-type extension in order that Q matrices 
remain unchanged. Of course, we can consider extensions of other types. For 
instance, for some minimal processes we can introduce the V-type extension so 
that for such an extended process X = {x(t),t <o} has only a finite number of 
leaping intervals in [0,t] for any t < o(m), and ail leaping intervals except the 
first one are „U intervals. Also we can introduce extensions of mixing D-type 
and V-type, but in this chapter we shall only give a simple and elementary 
discussion of it. 


11.2 D-TYPE EXTENSION 

Suppose P(t) = {p,,(t)} (i, je E, t > 0) satisfies conditions (2.2.A—C) and 
> Bilt) <1 
j 


for some ic E (1) 


Suppose that we are given a distribution x = {x,,ie€ E} satisfying 


O0<)'x;<1 (2) 
i : 
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Lemma 1. There exists a probability space (Q, F, P) on which may be defined 
a sequence of processes X" = {x"(t),t < o"} (n > 0) with the following properties: 


(i) X"e (n> 0), and they have the same transition probability matrix P(t). 
(ii) {o" =O}Ufo"= œ} c {a"*! =O} n20. 
(iii) P{x"*1(0)=j|0 <0" < wo} = nj, P{o"** =0/0<6"< œ} =1—S yn, 
(iv) Given that (0<o"< œ) or {x"*!(0)=i},X"(m<n) and X™(m>n) are 


conditionally independent, i.e. for O < tmi < tn2 < < bn jms jn -Jmn E 
E, if we put 


An = (xlt mr) = jmk> Isks lm (3) 


then for any /> 1 and n20 we have 


inaina Bas} 


a=n+1 


where A = {0 < o” < œ} or A = {x”+ 10) = i}. 


Proof. Utilizing the technique of making an independent product space, with 
no difficulty we can prove that there exists a probability space (Q, F ,P) on 
which may be defined a sequence of processes X° = {x°(t),t < 0°}, X? = 
{x?(t),t <o7}(n > 1, ieE) and a family of random variables f"(n > 0), taking 
values in E with the following properties: 

(1°) X° and Xe (n > 1,i€ E) and they have the same transition probability 
P(t). 

(2°) P{x°O)eEE} = P{o° >0}=1 


P{x?(0) =i} =1 (n> 1,ieE) 


P(e (ieE) P{f"= %}=1— 7, 


(3°) All X°, X?{n > 1,ieE) and f",n>0, are independent. 

Let C(t) be the indicator function of the set {110<r<o}. If 
we{f =i, C(o°) = 1} (ic E), let aw) = o (w); and x(t, w) = x} (t,@) for t < o'(w); 
otherwise let o(w)=0. If we{f' =i,C(o')=1} (iE B), let o?(@) = o2(w) and 
x?(t, w) = x}(t,w) for t < o(@); otherwise let og2(w) = 0. Continuing the procedure 
we can obtain a sequence of processes X" = {x"(t),t < on (n> 0). It is easy to 
see that X"ex (n> 0) and has the transition probability P(t) for each n> 0, 
and so property (i) holds. It follows from the structure of X” that they also 
have property (ii). 


‘Generally speaking, the initial distribution of a process has total mass |, but in this lemma for 
the processes X"(n > 1), we drop the restriction, i.e. it is permitted that P{0 < 0"} < {n> 1). 
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Because a” only depends on X°,X7(m<n,ieE) and f"(m <n), by (1°) and 
(3°) for jeE 

Pix" 'O)=j,0<a"<aop=P{f"=j,0<0"< a} 

= P{f"=j}P{0<0"< œ} = n;P {0 < o" < œ} 

This is just property (iii). 7 

For the proof of property (iv), fixn and jeE temporarily. Let X° = X%*?, 
Xr =xtt"+! fra pr*m*) As we defined X"(m>0) by X°, X7(m > 1,icE) 
and f™ (m > 0) just now according to X°, X" (m > 1,icE) and f™{m > 0), we can 
determine X” = {X"(t),t < g"} (m 20). Obviously, X” (m > 0) only depend on 
X@(m>n,icE) and f"(m> n) and if we put 


eee = (elas ey) =Jutm+ 149 ! <k< Laat 


d n+ n n+l 
ie fy A Me Ns 


we can easily see that 
Lo" tO=faNn ={x"Q=jpan 
and 
P{N} = P{N|x"*'(0)=j} 


So from (1°), (3°), property (iii) and the fact that An{x"*'(O)eE} =A for 


A={0< 0" < œ} we obtain that 


P{MNA} =} P{MA, x"*"(0) =j,N} 
=F P{MA, f"=j, Ñ} 
=F P{MA}P{f"=j}P{N} 


=) P{MA}n;P{N]x"* (0) =j} 


J 


It 


P(MA)), P{x"* 1(0) = j|A}P{N|x"**(0) =j} 


= P{MA}P{N|A} 


From this we are sure that property {iv) is true for A = (0 < g” < oo). For 
A= {x"*'(0)=i} it can be proved similarly. The proof is completed. QED 


Theorem 2. Assume that the sequence of processes X” = {x"(t),t < a"} (n > 0) 
defined on the same probability space has the properties (i)-(iv) in Lemma tł, 
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Let 
2° =0 hey ot o= y o (5) 
a=0 a=0 
. For O<t<a let 
x(t) = x"(t — t”) V<st<crt! (6) 
Then: 
(i) X = {x(t) t<o}ewr. 
(ii) The transition probability {p,(t)} of X is given by 
t 
Pit) = P(t) + | nit — s)dK;{s) (7) 
0 
where 
mt) = 2 p(t) (8) 


and K,(t) is defined as follows 


L(t)=1~-P pe) L=}f mL; 
i i 
ift < 

11) = A i t<0 

1 ift>0 
了 Fici IL 

Ki= >) Lal (9) 
n=0 
where * represents convolution. 
(iii) X is an honest process if and only if 


J 


Proof. Because X” are canonical processes, if only we have shown that X is a 
homogeneous Markov process, we can confirm that X is also a canonical one, 
and so (i) is proved. 

For Ogt <t,<--<&< tas jj .jt EE, let 


k 
A, = Q {x(t,) = ja} (11) 


k 
A(m,,m2,...,m) = () pta — 1") = ja St < 1+1 (12) 


a=! 
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It is clear that 
f = 
PLA, i} = > 
Om +1 


Abbreviate A(m,,...,m,) = A,. 
Suppose m, = m+, =m. Then there exists k<1 such that m; <S- < m, < 
My) =o = M,=m,,, =m. Hence 


P{A(m,,....7m4,)} 


P{A(mi, m2,..., m+ 1)} (13) 


=F P{Ag, T" S tye 1 XO) = Ext, T=,k+l<aglt+!l} 


tk +1 
| P{x™(t,—t™) =j,k+b<a<lt 1A, t” = s, x”(0) =i} ds 


0 
x P{A,,t" <s,x™(0) =i} (14) 


Since A, and t™ only depend on X"(n <m — 1) it follows that by Lemma 1 (iv) 
the integrand in (14) is equal to 


Pix"t,-—s)=j,k+1<a<1t 1A, Tt" = s, x”0) =i} 
= P{x"t,—s)=j,ktl<a<i+1|x"0)=i} 
= P{x™t,—s)=jakt1<a<lx™O)=i}p,,. (41-4) 
= P{x™t,—S}=jakt+1<a<llAy,t"=s,x™0)=i}0,;,. ia it) 


Substituting this into (14) and reversing the above operation, for m; =m,,,=m 
we arrive at . 


P{A(m,...,™,,,)} = P{A Pan (trey 一 二 (15) 
Now suppose m, = m<m,,, =. By Lemma | (iv), 
P{A(mi,..., m+1)} 


=}, P{A, x(0) = X(t TT) Sjah Stay} 


tiat 
= zf P{x (t — Tt) = jalin T = s, x (0) = i} ds 
i fi 
x PAn T <s,x"(0) =i} : (t6) 
Also by property (iv) in Lemma 1 the integrand is equal to 


PIX (4 — 3) =j 1X) =i} = Pins bra — 9) (17) 
Again by Lemma If ({ii)-{iv), 


fe RP A age re he a of ee ce eRe A 


eT rer rey 
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PLAN <s,x"(0) =i} = P{A, t <s,0 <a" | < c,x"(0) = i} 


= P{A T S s,0 <0"! < wn (18) 
If it can be shown that for 
PIAT SS0<o < co} = P{A Lar L" DG 一 器 (19) 
then substituting (15)}-(19) into (13) we obtain that 


PIAA b= > 


Osmi <- sm 


P{A,} {Bi AGEs T tı) 


+ ¥ | gs es (Le | 


ji 
mi+iSmH+idt 


eee 


Osm sosm 


PAD Brilis — 4) 


ti+1 
+| Rs (bay ~s)dsK is} 


I 


= PIAL P iui, (ty. a t) 
This demonstrates that X is a homogeneous Markov process with the transition 


probability {p;;(£)}- 
Proof of (19): We have to prove that 


P{A,,U Ss +i 0 <0! <0}=P{A}(L *L " ')(s) 


Assume y =m + 1. The left-hand side of the above is equal to 


s20 (20) 


X P{A,_,.t% +o" Ss +t, x"(0) = i x” 1") = jat St) 
i 


-zf P{x"(t, — T”) = jn T" +0” < 8 + hil A-1, T” = u, x"(0) = i} du 
t vO 


x P{A xO iSu} 
By Lemma I(iv) the integrand is equal to 
P{xMt,—u) = jno” <s + i — ulx"(0) = i} 
= P{x™(t, — u) = ji) x"(0) = i} La(s} 
Substituting this for the original and reversing the above calculation, we obtain 


that the left-hand side of (20) equals P{A,}L,,{s), ie. (20) holds for r =m + 1. 
We will prove (20) by induction. Suppose r > m+ 1. Then the left-hand side 
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of (20) is equal to 


F PIAT lo 和 +f 1(0)=i 
i 


st+t; 
a P{r lito lgstihlA,t =u,x" (0) = idu 
i vi 


l 


But P{o 1 &s+t —ulx T {0)=i}= L{s+ti— u), and by Lemma I(ii)-(iv) 
and the hypothesis of induction, for u > t; we have 


P{A,, T <u, 10) = i} = P{A,, 0! u0 <0? < 0,x t0) =i} 
= P{A T <u0<0'? < o}n,; 
= P{A La Tiu — t)r; 
Thus the left-hand side of (20) is equal to 


StH; 
>| m,L{s +t uP{A du(La L1 (u — t) 


= P{A,} [us — v)dvo(L,*«L ~~ "7! )(v) ) 
o 


= P{A {Li T" \(s) 


Thus (20) is verified. 
Summing over jEE on (7) we obtain that 


È Pilt) =1- L(+ | 5 r{1— L(t—s)}dKi(s) 


oJ 


a=] -10+ | ( ny L=) Ja 
o\s 

=1—Lt)+ (E2,) Kan 5 (Li*1°* D(t) 
J n=0 


-kai 


j 
On account of this, there exists at least one i such that K; #0. Therefore X is 
honest if and only if (10) holds. The proof is completed. QED 
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Remark I 


The first part X° = {x°(t),t< o°} of the process X = {x(t),t < o} in Theorem 2 
is a stopping process and satisfies 


P{x(t')=j|t! <o}=a, (21) 
Moreover their transition probabilities have the relation (7). We call X a 
x= {x,,j€E} D-type extension process of the stopping process X°. 
Remark 2 


Taking the Laplace transform of (7) we obtain that 


T = Yeh (A) 
ij A = yi A i A SS 


where w(t) and w(t) are the Laplace transforms of P(t) and P(t) respectively and 


(22) 


EW=1- 47,0 (23) 


11.3 D*-TYPE EXTENSION 


In the previous section we did not require the finiteness of the Q matrices. In 


this section we assume that ali O matrices are finite. 


In the D-type extension, if the Q matrix of X° is conservative, from the sample 
paths of the process we know that X° and its D-type extension process X have 
the same Q matrix. But if the Q matrix of X° is non-conservative, then the Q 
matrices of X and X? may be different. In order to preserve the Q matrix we 
introduce the D*-type extension. 


Definition 1. Suppose X = {x(t),t <a}e#,. We call o(w) the T-tail of X (œ) if 
0 < a(w) < oo and o{w) is a jump point (see Definition 7.8.1); otherwise we call 
o(q@) the P-tail. 


Obviously, if the transition probability of the process X° = {x°(t},t<o }exH, 
is P(t} then the following quantities 
M(t) = P,{x°(t) =j,0° is a P-tail} 
N,,(t) = P){x%(t) =j, 0° is a T-tail} 
M(t) =) Mit) NA = 2 N 0) (1) 
J J 


R(t) = M0) — Mt) = P;{o° <t,o° is a P-tail} 
and uniquely determined by P(t). 
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Imitating Lemma 2.1, we have the following: 


Lemma l. Assume that P(t) satisfies conditions (2.2.A-C), R,(t)>0 for some 
ieE and t > 0, and the distribution x satisfies (2.2). Then there exist a probability 
space (Q, F, P) and defined on it a sequence of processes X” = {x"(t),O0<1<o"} 
(n > 0) with the following properties: 


(i*) X"e x (n > 0) and they have the same transition probability P(t). 
(i*} {67 =O} U{o" = ow} VU {o’ is the T-tail of X c {o"* 1 =O} (n> 0}. 
Gii*) P{x"* 10) =j|A} = n; P{o"*' =0|A} = 1—Sj2;, where A= (0< a"< oo 
and g" is the P-tail of X”). 


{iv*) Given that {0 < g" < oo and ø” is the P-tail of X"} or {X"*1(0) = 
X™(m <n) and X™(m> n) are conditionally independent. 


i}, then 


Theorem 2. Assume that processes X" = {x"(t),t<o"}(n 20), defined on the 


same probability space, have the properties (i*})-(iv*) in Lemma 1. Define- 


X = {x(t),t < a} according to (2.5) and (2.6). Then: 
(i) Xe, and X"(n > 0) have the same Q matrix. 
(ii) The transition probability P*(t) = {pž(t)} is given by 


PEt) = Pult) + | 


0 


t 


nit — s}ds K+(t) (2) 


where z(t) is determined by (2.8) and K * by (2.9) but L,(¢) in it should be replaced 
by R,(t) in (1). 
üii) X is an honest process if and only if Q is conservative and (2.10) holds. 


Proof. Imitate the proof of Theorem 2.1. But the last conclusion i in the theorem 
requires a new proof. By (2) it follows that 


DPH=1—{ N (0) NO} {1 -Tmt PrN Kr 
k k 


+ | Fm Nalt — sdK#(s) (3) 
Ok : 
If Q is conservative, clearly N;(t) = 0, and if (2.10) holds, then by (3) 2 j,p#() = 
i.e. X is an honest process. Conversely, if X is an honest process, aa 
N,{t)= 0. Otherwise, for some i we have N,{t)= P;{t<o°,o° is the T-tail of 
X°}>0. Then according to Lemma 1(ii*) on the set {t < a°,g° is the T-tail of 
X°} of positive probability, o = g? < œ, which contradicts the hypothesis that 
X is honest. So by N,{t) = 0 and (3), (2.10) holds. We claim that Q is conservative. 
In fact, if for some i, d; = q; — 1, 4;4i; > 0 then we have 


P,{0 < 0° < œ,0° is the T-tail of X°} > d;/q;> 0 
and so N,(t) > 0, which is impossible. QED 
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Remark ! 
Taking the Laplace transformation in (2), we get 
A 4) 
1 一 IEAA, À) 


where w*(2) and (4) are respectively the Laplace transforms of P*(t) and P(t), 
and €,(A) is the Laplace transform of R,(¢) in (1). 


(WD = Wij(A) + EA) - (4) 


Remark 2 


We call the process Xe #, in Theorem 2 the 1D*-type extension process of 
X°e#H,. The process X? and its D*-type extension have the same Q matrix. If 
X? satisfies the system of backward equations, so does X. 


Remark 3 


When Q is conservative, because there is no T-tail the D*-type extensions and 
D-type extension are the same. 


11.4 DOOB PROCESSES 


In the D*-type extension, if X° or {j,,(t)} is the minimal Q process, using the 
representation of Martin exit boundary B., R,(t) in (3.1) becomes 


Lt) = P,{o° <t,x(o° — 0)eB.) (1) 


and Theorem 3.2 becomes: 


Theorem 1. Suppose {f;,(t)} is the minimal Q process. For some i and t > 9, 
L(t), defined according to (1), is positive. Let z satisfy (2.2). Suppose 
X"e#,(Q)(n > 0) are minimal Q processes defined on the same probability 
space with properties (ii*)-(iv*) in Lemma 3.1. Let X be defined according to 
(2.5)-(2.6). Then Xe ,(Q) and its transition function is given by 

pit) = f(t) + | nlt — s)dK (s) (2) 

0 

where z(t) = Tin fyt), and K;{t) is determined by (2.9), but L,{t) in it should 
be understood as (1). Moreover, X is an honest process if and only if Q is 
conservative and (2.10) holds. 


Definition 1. A xD*-type extension process of the minimal Q process is called 
a (Q, xz) Doob process. 


284 EXTENSION OF PROCESSES 
For the (Q, z) Doob process X = {x(t),t <0}, 
P{x(t) = i|x(t — 0)EB,} = 7; ieE . {3) 


P{o=tix(t— OeB.}=1— Yn (4) 


where <t is the first leaping point. The Laplace transform of (2) is 


yadda) B41) eee 
WD = bf) EED OME 
= Ad) +E (a) pu (5) 


(上 一 Ye) BS Yate Lt — - E,(A)] 


where ¢,(4) is the Laplace transform of L,(t) in (1). Particularly, when QO is 
conservative, 


EW) =1- AE 6,2) | (6) 


11.5 GENERALIZED D-TYPE EXTENSION 


The D-type and D*-type extensions do not involve the boundaries of processes. 
We will consider in this section an extension that depends on boundaries of 
processes. 

For a finite Q matrix Q, according to Chapter 7 we can determine the essential 
Martin boundary B, the exit boundory B, and the passive boundary B,. Recall 
that H denotes the non-conservative state set. 

Assume that the minimal Q process X = {x(t),t < t} is stopping, i.e. for some 
i, P;{t < co} <0 or, equivalently, un{H UB.} >0, where measure u is defined 
according to (7.12.2). : 

Clearly, for a Borel set IT c HUB,, the quantities 


L(T,t) = P;{x(t — O)eT,t <t} t>0 | (1) 
hT, 4) = Ejfe~*, wt jer} = | sara A>0 (2) 
0 


are uniquely determined by Q. 
We are given a family of distributions TI{a,)(ae H vu B,), satisfying 


l(a, E) <1 | Tía, E)u(da) > 0 (3) 
AUB. 


Lemma 1. There exists a probability space (Q,.4%,P) on which a sequence of 
minimal Q processes X" = [x"(t),t < o"}€,(Q)}(n > 0) can be defined, with the 
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following properties: 
(i) {0" =O} Ufo" = Œœ} {o"*! =O}. 
{ii} On {x"(o” — Oje HUB, }, almost surely 
P{x"**(0) =j|x"(o” — 0)} = H(x"{o" — 0), j) jeE 
P{o"*! =0{x"(o"” — 0)} = 1 — N(x"(o” — 0), E) 
(iii) For A,, determined by (2.3) 


y w= 


n+i 
=P} ad eno=i}P | NA 1 O)=i1 (ie E,1> 1) 
a@=nttl 
{iv) On the set {x"(o"—O)EH UB, }, almost surely 


Py, x"(o" -时 j- Py À adx A, |x"(o" -oj a oo 


where A, are also given by (2.3). 
Proof. By the technique of making an independent product space, it is not 
difficult to show that there exists a probability space (Q, Z, P) on which can 
be defined a sequence of minimal processes X° = {x°(t),t<o°}eH,, Xt = 
{x"(),t<o"}e#, (nei,iceE) and an E-valued random variable f"(a) 
(n > 0, aeH UB,), with the following properties: 


(1°) P{x°()eE} = P{x"(0) =i} = 1. 
(2°) P{f"(a) =i} = (0i) (ieE); P{ f"(a) = œ} = 1 — M (a, E). 


(3°) All X°, X"(n > 1, icE), f"(a) (n> 0, aeH UB,) are independent. 


If we{x°(o° —0)eH UB., f°[x°(a® —0)] =i} (ieE), let cl(o)=cl(o) and 
x'(t,w)=x/(t,@), t<o'(w); otherwise, let o!(w)=0. It is easy to see that 
X = {x}(t),t<o'}e#, is a minimal Q process. Therefore gt > 0, and one can 
define x'(o'—0). If we(x'(o'—OeEHUB,, f'[x'o'-—0)]=i} (lieE) let 
o7(@)=a}(w) and x7(t,@)=x2(t,w),t<a7(w). Otherwise, let cz(w)= 0. 
Continuing with this step, we can obtain a sequence of processes X” (n > 0). 

Just as done in Theorem 2.1, one can prove that X"e #, (n > 0) are all minimal 
Q processes and have properties (i)-{iv) in this lemma. QED 


Theorem 2. Suppose that the minimal Q processes X" = {x"(t),t<o" eH, 
(n 20) defined on the same probability space possess properties (i)—{iv) in 
Lemma 1. Define X = {x(t), t < o} according to (2.5)--(2.6). Then: 

(i) If {fs.T(a, E)u(da) = 0, then Xe, is a minimal process and its Q matrix 
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is different from that of X°. If f Ml(a, E)s(da) > 0, then Xex, is a process of 
order |. 
(ii) The transition probability {p;;(t)} of X is given by 


Pit) = fit) + 2 | filt — ss}ydKi(s) (4) 
0 


where K,,(t) are determined by 


Tift) = | I (a, j)L{da, t) 
Ho Be 


TOs | a), [Ti.C-)* Ly(da, -)] (1) (5) 
HuB 


Ki) = > TH) 
n=1 


Here * represents convolution, i.e. 


(TROL, 10 = | Tat- 9LAD d) 0 


0 


Making some changes in (4) we obtain that 


pit) = fit) + | [ n (a, t — s)K (da, ds) (7) 
HUB, VO 
where 
7,(a, t) = 2, M(a, k) f(t) (8) 
Li (T, t)= LAT, t) (see (1)) (9) 
L*+1(T,t) = [f Li(da, ds)¥" TI (a, k)L,(T, t — s) (10) 
0 HuB, k i 
KT, s) = J LMT, s) ` (11) 
n=1 。 


We can imitate the proof of Theorem 2.2 to prove Theorem 2. The only 
difference is that the latter is more complicated in writing. Although the proofs 
of the theorems in sections 11.6 and 11.7, which we have omitted, are similar 
to this theorem, we still give a brief clue to the proof of Theorem 2 here. 


Proof. We need only verify that X is a homogeneous Markov process with 
transition probability (4). The rest is clear. l 
Determine A, and A(m,,...,m,)=A, according to (2.11)--(2.12) and the 
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formula (2.13) still holds. Following the proof of (2.15), in the present case (2.15) 
still holds for m, = m,, 1. E 
Assume m, < m,,,. Abbreviate m, = m, m,,, = Y. Then by Lemma 1(ii), 


Pl Aun = ¥ P{A,t) <1 Sfi <T +0", x (0) =k, x(t —T)= j1. 
k 


fr+ 
s) P{x(tiy1—7)=jy1|A, r= s, x'(0) = k} ds 
k 


1 
x P{A,,t' <s,x'(0)=k} 


f+ 


= Seje (tia, —S)dsP{A,, T <s, x0) =k} (12) 
k ty 
If it can be proved that for s È t, 
P{A,U <3, xO) =k} = Ths — t) (13) 


combining (12) we obtain 


fred 


P{Airi} = 2 P{Aj} TELU S s)ds TM ™(s ~t) 
k 


f4 
IE+1 一 本 


Sin. fti41 — sds TZR ITs) (14) 


jik 


= Pant | 


0 


and substituting (2.15) and (14) into (2.13) we find that P{A,, =P{A} Pija X 
(t14,; — tı) where p,,(t} is determined by (4). Therefore X is a homogeneous 
Markov process. 
To prove (13) is to verify 
PAn T <s4+t,x(0)=k} = P{A)}T IVs) s20 (15} 


Jik 


By Lemma 1(iv), the left-hand side of the above is equal to 


| P{A,, x(a"! — Ojeda, xX (0) =k, <s + ty} 
HuB 


=| (a, k)P{A,, lo !— Ojeda, Ss + ty} (16) 
HuB 


First we deal with r =m + 1. Then 
P{A,, x" (071 — O)eda,t’ <s +t} 


=F P{A 1, x(0) = i, x"(h — 2”) 


= jp T" St, <T” +0", xo" — Ojeda, t” +0" Sst ty} (17) 
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By Lemma I{iii), the summand in the above equals 


| P{x™t,— u) 


0 
= Jy x"(o" — Ojeda, o™ < s + t, — ux"(0)=i duP{A 1,x"(0)=i,t™ <u} 


ti 
E | Fights — u)Lj,(da, s)duP{A,_ 1, x”(0) = i, t” < u} 
0 


Substituting into (17) and reversing the above calculation we see that the 
left-hand side of (17) equals P{A,}L,,(da,s). Thereby substituting into (16) we 
know that (13) holds for r = m + 1. By a similar consideration and by induction 
we can confirm that (13) holds for all r > m. The proof is terminated. QED 


Denote the Laplace transform of Ti At) by Gi(A). Define h{T, A) by (2). Then 
from (5), 
Gia) = 2 Gi, (ANG, (A) 
k 


Thus it follows from (4) that 
Wild) = bifA +). ( > Gul) ) 60 (18) 
k n={1 ` 


When Q is conservative, the above expression is precisely formula (10.2.25} in 
Kunita (1962). We shall use matrix symbols. Write G(4)= G!(2). Then (18) 
becomes 


WA) =O) + Y GAS) (19) 


Setting 
hi, A) = | et dtLHT, £) (20) 


0 
it follows from (9) and (10) that 
hi(V, 4) = A(T, A) 


ArT, A) = | hi{da, ray (a, kh, (7, 2) (21) 
HuB, k i 
Hence (7) becomes 
Wi fA) = (A) + | ( 3 hi(da, ay (a, k) py (4) (22) 
Hus, \n=1 k 
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Letting 
0 ag 
Vla, T, A} = 
o ) | ] ae. 
V\a,T, 4) 一 》 Il{a, k)AR(T, A) (23) 
k 
we have 
V"*l(a,T,4)= | V"(a, db, A}V 1(b, T, 4) {24) 
HOB, 
hr * lr, A) -{ hi(da, A)V"(a,T, A) (25) 
HUB, 


Consequently {22) becomes 


Wi fA) = pil) +{ hi{a, | ( > V"(a, db, »)( $ Nob, ogu) (26) 
HOB, HoB, \"=0 k 
When Q is conservative, this is just formula (10) in Kunita (1962). 


Definition 1. Cali X in Theorem 2 the {I(a, +), ae HU B.} generalized D-type 
extension process of X°. 


Clearly, for X° and X in Definition 1, on the set {x(a° — Oje H UB, } almost 
surely holds 


P{x(o°) = j}x(o° — 0)} = T(x(6° — 0), j) jeE 


11.6 GENERALIZED D*-TYPE EXTENSION 


When Q is conservative, the generalized D-type extension preserves the Q matrix. 
But when Q is not conservative, things may be different. Hence we introduce 
the generalized D*-type extension. 

Suppose the exit boundary B, of the minimal Q process is non-empty, Le. 
H{B.} > 0. Given a family of distributions IT(a, ‘) (ae B.) satisfying H(a, E) <1 
and fg, Tifa, E)u(da) > 0. 

Let 


II(a, E) =0 acH (1) 


Then the basic conditions in section 11.5 are satisfied and so Lemma 5.1 and 
Theorem 5.2 are still valid. 


Definition 1. Suppose X° is the minimal Q process. A {I(a,:), aeHUB,} 
generalized D-type extension of X° that satisfies (1) is called a generalized 
D*-type extension. 
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Clearly, when Q is conservative, the generalized D-type and generalized . 


D*-type extensions are identical. The following theorem is obvious. 


Theorem 1. The minimal © process X° and its {M(a,-), aeB.) generalized 
D*-type extension process X have the same Q matrix. More precisely, X satisfies 
the system of backward equations and, moreover, on {x(t —0)eB,} almost 
surely holds 


P{x(t) = jlx(t — 0)} = I {x(t — 0), j} (2) 


11.7 EXTENSION OF INSTANTANEOUS-RETURN PROCESSES 


In this section we shall give a brief discussion of extensions of instantaneous- 
return processes. Because the proofs are similar to those in sections 11.5 and 
11.6, they are omitted. 

Suppose X = {x(t),t<oa}e#, is a kth-order instantaneous-return process 
with transition probability ,p;{t) and ith-order exit boundary ,B,. Instead of 
H U B, in section 11.5 we consider ,H U,B,, where 

rH = H+ 9B, tB. + +41 B, (1) 


The measure on ,H U,B, is ,u for order k. Assume that X is a stopping process, 
Le. {HOB} >0. We are arbitrarily given a family of distributions 
(a, -)(ae,H OB.) satisfying 


Ta E) < 1 | „l(a, Eu(d@) >0 (2) 
RH Be 


Lemma 1. There exists a probability space (Q,¥%,P} on which a sequence of 
processes X” = {x"(t), t<o"}e#, (n 20) can be defined, with the following 
properties 
(i) X” (n 2 0) have the same transition probability ,p,,(t). 
(ii) (" = 0)U(o" = œ) c(o"*! = 0). | 
(iii) On the set {x"(o" — Oje, HU,B.} almost surely hold 
Pfx (0) =j|x"(o" — 0)] = ,T1(x"(o" — 0), j) 

P{a"*! =0|x(o" — 0)} = 1 — ,f1(x*(o" — 0), E) 
(iv) The same as Lemma 5.1(iii) 
(v) Obtained by changing HUB, in Lemma 5.i(iv) to ,HU,B,. 


Theorem 2. Suppose that processes X"e.#, (n 20), which are defined on the 
same probability space, have properties (i)-{v) in Lemma 1. Define X = {x(s), 
t <a} according to (2.5)-(2.6). Then: 
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(i) if fg.xH(a, E),u(da)=0 then X eX but the kth-order exit boundaries of 
X and X°’ are different, and if the above integral is positive, 
(ii) the transition function ,,,p,,(t) of X is given by 


k+ 1Pijlt) = Pilt) + > | P(t — 5) ds, K a(s) (3) 
! v0 
or 
x41 Pill) = Plt) + | | xTe(a,t — s} Ki(dads) (4) 
xHuxBe JO 
where 
nla, t) = » kila, i), p; (0) (5) 


and ,K,,(t), „KT, t) are still defined according to (5.5)—(5.6) and (5.9)-(5.11), but 
the following changes should be made. To each of L,(T, it), M(a,-), H, Be T?(t), 
K,,(t), LT, t)and KT, t) should be added a left subscript k, and for I c H O Bo 
moreover, 


LAT, t) = P;{x(o° — eT, 0° <t} (6) 


Correspondingly, after the obvious supplements to those lower left corners 
in (5.18)-(5.26} we have 


ed) = w+ ¥ GGA WA (7) 
n=1 
ab) = ed) + | | X nda, n} Ea, wp)) (8) 
kHukBe 下 站 二 


pt Wil) = Wij) +| rhi(da, A) 


kHOkBe 
x | (È „V”(a, db, »)(Zune, Dab) (9) 


Definition 1. Call the process X in Theorem? the {,II(a,-), ae,HU,B,} 
generalized D-type extension process of X o: 


For X and X° given in Definition 1, on {x(o° — 0)e,HU,B,} almost surely 
holds 


P{x(a°) = j|x(o° — 0)} = (x(a? — 0), j) (10) 
Note that X and X° do not necessarily have the same kth-order exit boundary. 


Of course, their Q matrices may be different. Therefore it is necessary to introduce 
the generalized D*-type extension. 
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Assume that the kth-order instantaneous-return process Xe, satisfies 
ko > 0. Suppose we are given a family of distributions ,H(a,-) (ae,B,) 
satisfying ,M(a, E) < 1 and f, x, F(a, E) ulda) > 0. 


,[1(a, E}=0 ac,H (11) : 


Then the basic conditions at the beginning of this section are satisfied and so 
Lemma 1 and Theorem 2 are valid. 


Definition 2. Suppose X°e#,. The {l(a,.), ae HuUB.) generalized D-type 
extension of X° satisfying (11) is called a generalized D*-type extension process. 


Theorem 3. A kth-order instantaneous-return process X°c#, and its {,M(a,:), 
ae,B,} generalized D*-type extension process have the same /th-order exit 
boundary ,B, (l< k). Particuarly, they have the same Q matrix and X satisfies 
the system of backward equations. 


11.8 ON NON-STICKY EXTENSIONS 


From now on, we turn to the V-type extension. The D-type extension is of 
instantaneous-return type: after a process moves to infinity it returns to finite 
states instantly. Of course, a process may return to finite states slowly from 
infinity. This is just the V-type extension. We may also have the mixed DV-type 
extension. 

When Chung (1963, 1966) studied the boundary theory of Markov chains, 
he analysed meticulously their sample paths, introduced the concept of sticky 
and non-sticky boundary points and at last under the hypothesis of finiteness 
of exit boundaries obtained the analytic expressions for transition probabilities 
of processes. But he did not directly construct their sample paths. The D- -type, 
V-type and mixed DV-type extension processes are all non- -sticky return 
processes, i.e. processes whose leaping points may be arranged into a sequence 
in order of magnitude. A left-open and right-closed interval with its adjacent 
end-points being leaping points is a leaping interval, ie. U interval. The 
construction of sample paths on leaping intervals is the key to the construction 
of non-sticky return processes. 

The motion of a D-type extension process in each leaping interval is the 
motion of a minimal Q process starting from finite states. So an imbedded chain 
describing its jump behaviour is an ordinary discrete-parameter Markov chain 
(xm n > Q) with its starting time and an initial distribution concentrated in the 
state space E. But for a V-type extension process its motion on each leaping 
interval is the motion of a minimal Q process starting from infinity. An imbedded 
chain describing its jump behaviour should be (x,, — oo <n < + œ). However, 
it is not a Markov chain and nor is it a stationary sequence. It belongs to the 
class of approximating Markov chains introduced by Hunt, (1960) for the first 


STOCHASTIC CHAINS AND CHARACTERISTIC MEASURES 293 


time. Hence approximating Markov chains are precisely the foundation stones 
for our construction of non-sticky returning processes. But an approximating 
Markov chain is defined on a measure space which may have infinite total 
measure. 

From now on until the end of this chapter, we will first introduce approximating 
Markove chains and their characteristic measures and then study the relation 
between characteristic measure and the initial time and life-time of an 
approximating Markov chain. After that we shall use approximating chains are 
imbedding chains to construct sample paths on leaping intervals. Thus the 
so-called approximating minimal Q processes arise and therefore the minimal 
Q processes starting from infinity can be described. We establish the 
correspondence between entrance families and approximating minimal Q 
processes. Finally, on the basis of approximating minimal Q processes, we shall 
construct the sample paths of a class of non-sticky returning processes, i.e. we 
shall obtain the DV-type extension processes of minimal Q processes. In terms 
of entrance families we derive the analytic expressions of transition probabilities 
for this class of Q processes. Utilizing the boundary theory we can also construct 
other non-sticky processes that are more complicated, i.e. the so-called 
generalized DV-type and (DV)*-type extension processes. 


11.9 STOCHASTIC CHAINS AND CHARACTERISTIC MEASURES 


The concept of stochastic chains was introduced by Hunt (1960). We will give 
a brief description of their definition and results. Let E be a denumerable set 
and FI = (Il; i je E) a sub-stochastic matrix, i.e. a matrix that has non-negative 
entries and row sums that are at most 1. When the row sum is equal to 1, it 
is called a stochastic matrix. Let (Q,4%,P) be a measure space, ie. Q is a 
non-empty set of abstract points, ¥ is a Borel field composed of some subsets 
of Q and P is a measure on ¥. We emphatically point out that we do not 
require that (Q, Z , P) be a totally finite measure space. Henceforth N will denote 
the set of all integers. 


Definition 1. Suppose on (Q, F, P) a triple (x, a, $) is given: 
(i) « is an F -measurable ae with values in {—oo}UN, $ is an 
F -measurable function with values in No { + 00}, and for all weQ, a(~w) < Blo); 
(i) for each weQ and neN satisfying a(w) <n < B(w), there exists a unique 
x(n, w)eEE and for neN, icE, 


A(n, i) = (x(n) = i) = (w:x(n, w) = i, al) < n < B(o)eF 
We call (x, x, 8) a quasi-stochastic chain. 


For a quasi-stochastic chain (x, a, 8), write F (x, «, 8) for the minimal Borel 
field which contains all sets A(n, i) (neN, ie E) and call it the Borel field generated 
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by (x, 2, P). Write F(x, x, f) for the minimal Borel field which contains all sets 
A(n, i) (n < k, ie E). : 


Definition 2. Suppose that (x, x, £) is a quasi-stochastic chain. If for all ne N and 
ie E, P[A^A(n,i)] < + œ, we call (x,«, f) a stochastic chain. 


Because Q = | Jaen (Jie A(n, i), it follows that for a measure space (Q, F, P) 
on which a stochastic chain is defined, Q must be o-finite. 

We can define x(n, œw) for any neN. For example, take arbitrarily two indices 
A¢E, OE and A #0. For n<a(w) define x(n, w) = A, and for n > B(w) define 
x(n, @)= 0. Obviously, sets CO=A=(<o and {x{n)=0)={$ <n) are 
7 -measurable. But even for a stochastic chain (x, «, £), their measures are not 
necessarily finite. 


Definition 3. Suppose that (x, a, f) is a stochastic chain. If given ‘the present’, 
its ‘past’ and ‘future’ are conditionally independent, i.e. for any k,m, neN, 
k<m<nand i,, i,4,,...,1,€£. Putting 

A = A(m, inn) A I] (j, i;) A” = I] AG. i,) 


hojeom mj<n 


P(A'A’) _ P(A’) P(A") 


P(A) P(A) P(A) 
as long as P(A} > 0. We call (x,&, $) a Markov chain. 


Definition 4. Suppose (x, a, B) isa Markov chain. Iffor any neN, ic E, we have 
P(x(n) =i,x(n + 1) = j) = P(x(n) = DID 

we call (x, a, $) a M-chain. The matrix IT is called the (one-step) transition matrix 

of the chain. 

Definition 5. Suppose (x, x, 8) is a stochastic chain and ø ts an ¥-measurable 
function which is defined on Q and takes values in { — 2o}UNU{ + x}. Let 
Q =(cEN,a <0 < P) F'nNF P(A!) = P(A’) A'eF' 

For we’ let 
(a) = B(@) — oa(w) y(n, w) = x{a(w) + n, w) 


If (y,0,7) is a T-chain on (Q, F’, P’), we say that the random time g leads 
the stochastic chain (x, a, £) to the I-chain (y,0, y). Write 


Jex% P) = (y, 9,7) 


Definition 6. Suppose (x, 2, f) is a stochastic chain. If there exists a sequence of 
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random times xn n> 1, taking values in NU{ + œ} such that on Q almost 


` surely a, | and each a, leads the stochastic chain (x,a,f) to some H-chain 


f(x. B), we call (x, a, 8) an approximating M-chain. 


Definition 7. Suppose (x, a, $} is a stochastic chain and a is an Z -measurable 
function with values in Nu { + oo}. If for any neN, (o < nje. F (x,a, B), we call 
g a random time independent of the future or a wide-stopping time. 


Definition 8. Suppose that (x, «, 8) is an approximating II-chain. If (x, x, 8) is a 
Markov chain and if the sequence of random times 2, which leads (x, g, 8) to 
a II-chain can be chosen as a sequence of wide-stopping times of the chain, we 
call (x, a, 8) a strong approximating II-chain. 


Write I” = M", and G= SII". Then Gi; & G; According to M we can 
divide the states in E into recurrent and non-recurrent states. A state i is 
Hl-recurrent if and only if G; = + «. 


Definition 9. Assume that 4 = (y;, JEE) is a measure on E, ie. 0 <n; < + æ (jeE). 
We call y finite if each y; is finite, and totally finite if $ n; < + œ. We say that 
n is a H-excessive measure if nfl < y, ie. Pal <y; (JEE), and that y is a 
H-harmonic measure if nil = y. 


Theorem l. Suppose (x,a, 8) is an approximating H-chain. Let CD be the 
measure concentrated on i with unit mass, i.e. C{i) = 1 and Cj) = 0 for j # i. Let 


n= | 2 CiLx()] dP = > P(x(n)=)) (1) 
QasnsP neN 

Then y =(y;, JEE) is a []-excessive measure, which is called the characteristic 
measure of the [-chain 


Proof. Suppose (x, 0, 8) is a I-chain with the initial distribution v. Then the 
characteristic measure determined by (x,0, 8} is y =vG. Of course, it is a 
Il-excessive measure. Suppose {x, «, $) is an approximating chain. Denote by y" 
the characteristic measure of the [I-chain f, (x, a, £). Then y” is T]-excessive, i.e. 
mI < n”. But n” Ty, so that yI < y, 1.e. y is M-excesssive. The proof is completed. 
QED 


Theorem 2. Suppose that (x,a, 8) is an approximating IIL-chain with a finite 
characteristic measure n. Let 
a= —f B =— a x(n} = x(—n) 
Then the inverse chain (x’, a’, $’) is an approximating Q-chain, where for n;>0 
Q; = milli/n; (2) 


iE | 
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and for 7; = 0, Q; may be chosen arbitrarily as long as Q,, is nonnegative and 
the row sums of Q are not more than 1. 


Proof. Suppose D is finite subset of E. Let t be the last exit time of the chain 
(x, x, 8) from D, i.e. 


(3) 


本 ie {n:a <n < B,x(n)eD} 


一 © if the above set is empty 


Clearly, — t is the hitting time of (x’,a’, p’) at D. Because 4(D) < oo by (1), we 
know that there are only a finite number of neN such that x(n)e D. Hence t < f 
and t < œ. 

First of ail suppose that (x, , 8) is a H-chain, « = 0 and its initial distribution 
is v. Determine Lp(i) according to (7.3.12). Then (7.3.16) is true, ie. 


P(x(t) = ig, X(t — 1) = i,,..., x(t —k) = i} 


= iMG, te OT 1 ik- 2) TG, io)Lplio) (4) 
where y = vG. 
The equality (4) also holds for the approximating Ti-chain (x, a, f). In fact, let 
fo (x, a, f) = (Xn 0, Ba) (5) 


and let rw be the last exit time of the H-chain (x,,0,8,) from D and y” be the 
characteristic measure. Then y"fy and for almost every we{t< œ} and 
sufficiently large n, 


Xq{T,(@2) — j) = x(t(@} j) 


Since (4) holds for (x,, 0, 8,), passing to the limit we are sure that (4) is also true 
for (x, «, P). 
For the inverse chain, (4) can be rewritten as 


a, {(@) + T) = tto) 


P(x’ (e) = ig, x'(e’ + I =i,,..., xe +k) =i) 
= n(io}Lp(io)Q(io, i), iz) p Oi, 一 1， iz} 
where g' is the hitting time for the inverse chain (x‘,a’, 8’) at D. The above 
equality indicates that 8 leads (x',&', f’) to a Q-chain. Take D = D,1E. Then 
t(D.) T8 and {D ) = — (D) La. Therefore, (x',a’,f') is an approximating 
Q-chain, and the proof is completed. QED 


Theorem 3. Suppose that (x,a, ß) is an approximating II-chain with a finite 


characteristic measure y. Let x(D) be the hitting time of the chain (x, «, $} at a. 


finite subset D of E, i.e. 


x(D) = i <n < f, x(njeD} 
十 oo if the above set is empty 


(6) 
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Then a < a(D), — œ <a(D), x(D) is a wide-stopping time, a(D)|« as DE and 
a(D) leads (x, x, $) to the M-chain 


fm x, P) = (Xp,0, Bp) (7) 


Proof. Consider the last exit time t(D) of the inverse chain (x’,a’, p’) from D. 
According to Theorem 2, 1(D)<f', t(D)< +o and r(D)TB as DE. 
Obviously, «(D) = — t(D). Hence, « < a(D), — œ < a(D) and o(D)|a as DTE. It 
follows from Theorem 2 that x(Dj leads (x,«, 8) to a []-chain. Finally, by the 
definition of x(D) it is easy to verify that x(D) is a wide-stopping time of (x, x, B) 
and we conclude the proof. QED 


Remark 


Theorem 3 demonstrates that for any approximating H-chain (x, «, 8) with a 
finite characteristic measure we can always choose a sequence of wide-stopping 
times «, | æ such that f, (x a, 8) are T-chains. However, (x, &, £) is not necessarily 
a strong approximating chain, for (x, «, $) itself may not be a Markov chain. 


Corollary 


Assume that (x,a,f) is an approximating [-chain with a finite characteristic 
measure y. Write vp for the distribution that (x, «, f) hits the finite set D, ie. 


Valj) = POx(a(D)) = j) (8) 


where a(D) is defined according to (6). Then the support of vp is contained in 
D and, moreover, 


Yal j) = ALU) 
where 
Li) = PA yoED, Wn)¢D for0 <n <ô) 
Here (y, 0,0) is a Q-chain and Q is determined by (2). 


Proof. Letting k = 0 in (4) we have 
P(x{t) = j) = nL) 
Applying this to the inverse chain (x’,«’, fp'} we obtain 
P(x'(t'} = j) = n LDC) 
where T is the last exit time of (x',a', BY from D, i.e. the hitting time of (x, w， B 


at D, and x’(t’)= x(o(D)). Then the above equality is just (9). The proof is 
completed. QED 
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Theorem 4. Assume that n is a finite [-excessive measure. Fix a sequence D, 
of finite subsets of E, D,1E. Then there exists a sequence of measures v” with 
the following properties: 

(i) v” is totally finite with its support contained in D,, 

(ii} v"G <n and equality holds on D, 
(ii) V"'GTy as nto; 


(iv) suppose n < m; then v” is the hitting distribution at D of the II-chain with 
the initial distribution vy", ie. if (x,0,8} is a H-chain with the initial 
distribution v” and the hitting times o(D,) lead (x, æ, 8) to T-chains (x,, 0, $p), 
then the initial distribution of (x,,0, 8,) is v” for each n < m. 


(v) there exists a measure space (Q,.¥, P) on which an approximating II-chain 


(x,a, B) is defined with its characteristic measure coincident with y and with’ 


Vp, determined by (8) coincident with v”. 


The proof of the theorem is a bit complicated. The reader is referred to 
Kemeny et al. (1966, Chapter 10, section 12). We point out that by (9) yw in 
Theorem 4 is determined by 4 and II according to 


wC) = nL) (10) 


11.10 INITIAL TIME AND LIFETIME OF APPROXIMATING 
Ii-CHAINS 


Let (x,a, 8) be a quasi-stochastic chain. We call æ the initial time and £ the 
lifetime. Note that from the statement under Definition 9.2, for all neN, x(n) 
are defined but they take values in E|_}{A,0}. We agree that C{A) = C(@) =0 
for jeE. Then, the II-excessive measure determined by the approximating 
F-chain (x, a, f) is 


n= 5 cixar = | Z Clxm]dp jeE (D) 
nN 


Qnen ENT 


Theorem 1. Let (x,a, Pb) be an approximating [-chain with the characteristic 
measure y. Then the following are true: 


(i) If TI is a stochastic matrix, almost surely B= + œ. 
(ii) If x = — œ, almost surely y is IIharmonic， 
(iii) Suppose n is finite and its Riesz decomposition is 


nani tn? n’ =vG y=n—nil and lim yl! =n? 
[++ 
(2) 
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Then the excessive quantity v can be expressed as 


v= P(— œ < g, x(a) = j) (3) 
the potential measure y' can be represented by 
= | tan (4) 
and the harmonic measure has ike representation 
ye = | py C [x(n)] dP (5) 


(iv) Suppose that y is finite. Then y is a potential if and only if — œ < g almost 
surely, and y is harmonic if and only if 一 oo = & almost surely. 


Proof. Suppose that random times «,, 1 > 1, lead (x, a, f) to [-chains (x,, 0, B,) 
on Q, = (x, EN, & < a, < f) respectively. 

(i) Assume that IT is a stochastic matrix. It is well known that for any T-chain, 
its lifetime is almost surely equal to + œ. Hence it almost goes without saying 
that B, = B — a, = + %, ie. B= + œ on Q, So f= +œ almost surely on Q 
since 0, 7 Q. 

(ii) Since 


Ni | 2 Cilx(K)IdP 
E9 


pasketau 


im | y CiEx(k)] dP 


于 一 to An <k< 十 oo 


Il 


lim >》 CiLx,(m)] dP 


n= + Q, 入 有 < +0 
十 ow 
= lim >》 P(x,(m)=i) 
n++o m=O 
it follows that 
+ 


lim Y Pom) =N 


n>+tom=0 


nilli; 


I 


lim > P(x,(m)=i,x,(m + 1) =J) 


na>+oOSm<+a 


lim | 》 CLx,(m) Cj [x,(m + DIdP 
í 


nataodg Dm +o 
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II 


lim | CLK) Cj Lx(k + D]dP 


n> +w nin Sk< +a 


| > Cdk) IC [tk + 1d P 
Q 


aska +o 
Taking summation over ieE, we have 
2 nM; = | Cj Lx(k + lJ dP = | >  C,[x(m)] dP (6) 
t NQas<k<+a Qatrleém<=a 
Ifx = — œ almost surely, then the right-hand side of (6) is equal to 7 ; Therefore 
y is harmonic. ` 
(iii} If y is finite, by (6) we have 
(nth); =n; — P(— œ <a, x(x) = j) (7) 
Then (3) follows. 
Similarly to (6) we have 


(IT), = | 》， C[x(m)]dP 
Q 


atigm< +o 


= | ss os C;Lx(m)] dP + i: i 2, Cj[x(m)] dP (8) 
Noting 
ne | 2, Calm dP | 2 Cjx(m)]dP<+0 (9) 


(8) becomes 


>  Cilxtn) dP ty; 


-~x<qgrsm<atl 


int!),=n)~ | 


= | > C,{x(m)] dP It +a 
-~g<cgrtem< +o 
Combining with (9) we obtain (5} and so (4) follows. 
(iv) When — œ <2 almost surely, by (5) we have y? = 0. Hence y=n!' is a 
potential. Conversely, if 7 is a finite potential, then yI’ 0. So that the second 
term of the right-hand side of (8) equals zero, i.e. 


$ P{— «© =a,x{m) =i} =0 


meN 


Sum over ieE, and we obtain — œ <a almost surely. 
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If — œ = x almost surely, from (4) we have 4’ = 0. Hence y = n? is harmonic. 
Conversely, if y is finite and harmonic, then by (7) P{— œ <a, x{a) =j} =0. 
Summing up over jeE, we obtain P{— œ <a} =0. We conclude the proof. 

QED 


Theorem 1 shows that the approximating I]-chain (x, x, 8) can be decomposed 
into two stochastic chains which are defined respectively on Q, =(— œ <a) 
and Q, =(— œ =a); nevertheless, they may not be approximating [-chains. 
Fortunately, we can make them become approximating I-chains very easily. 


Theorem 2. Assume that 1 is a finite II-excessive measure with the Riesz 


‘decomposition (2). Then there exist a measure space (Q,¥,P)} and an 


approximating I]-chain (x, a, 8) defined on it with the characteristic measure n. 
Furthermore, let Q, =(— œ <a), Q, =(— «© =2) and {Xa Xa Ba) = (x, %, f} on 
Q, (a= 1,2). Then (x,,@,, Bo) (a = 1,2} are approximating II-chains on Q, and 
they determine [-excessive measures n°, respectively. 


Proof. According to Theorem 9.4, for each a= 1 and 2 there exists a measure 
space (Q,, ¥,, Pa) on which an approximating IT-chain (x, «,, Ba) is defined with 
the characteristic measure 4°. By Theorem 1 we can take Q; =(— œ <a,) and 
Q, =(— 0 = &)). 

We can consider that Q, and Q, have no common points. Write Q=Q, VQ, 
and F = {A:AcQ, ANQ,€F,, a= 1,2}. Clearly F is a borel field on Q and 
Fac F. For AEF, let P(A) = Ps(ANQ,) + PAnR). Let wed, if weQ,, and 
define xfw) = a,(w), B(w) = B,(w), x(n, w) = x,(n,w). Then, it is easily seen that 
(x, %, 8) is an approximating II-chain, which is defined on (Q, F, P) and has all 
the properties presented in this theorem. The proof is completed. QED 


11.11 IMBEDDED CHAINS 


A matrix A = {a;; i, jE) is called a Q matrix if its entries in the diagonal are 
non-positive and finite, if the entries outside the diagonal are non-negative and 
finite, and if the row sums are non-positive and finite. When the row sums are 
equal to zero, the Q matrix A is called conservative. Suppose we are given a Q 
matrix Q = (q;;,i, je E). Then 


Saya TOUT) È qy < — qu< 十 o0 (1) 
ji 


Put q; = — qiu. We call d; = q; — Zixigi the non-conservative quantity of i. Recall 
that C(i) is the measure concentrated on i with a unit mass. Let! 


! For convenience, the imbedded matrix TI here is slightly different from that in (2.9.7). 


] 
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m= 人 — Ci) 19; 5/4; ifg; > 0 

i. 0 ifg,; =0 

We call the sub-stochastic matrix TI = (I, i, jeE) the imbedded matrix of Q 
and a H-chain the imbedded chain of Q. Recall that 0¢E. Write Ey = EU £6}. 
Let gig =d; (ieE) and qa = — de = 0. Then Qa = (q; i, JE Eo} is a Conservative 
Q matrix and the imbedded matrix TI of Q is a submatrix of the imbedded 
matrix To ={H;; i, je Ee). Clearly 


di/q; ifg; >0 
I, = , II — j 7 
0 r ifq,=0 ej = 9 jek, (2) 


For 4>0 let 


gifA) = qi li +j) qÀ} = 一 gid = A + Gj 


Then I1(4) = (4, {4), i, je E) is a non-conservative Q matrix. Its imbedded matrix 


is denoted by F(a) =(I;{A),i, jeE) and is called a 4-imbedded matrix of Q. 
Denote the 4-imbedded matrix of Q, by He = M; A2),i, jEEo). Then TI(4} is a 
submatrix II and, moreover, 


1, (4) = 一 一 一 人 i, jek 


di ，， 
Hie(4) = een (jek) 


1 


To(2) = O(jeEy) 3) 
Note that all elements in the 8th row of Tl, are equal to zero and the other 
row sums are equal to 1, and that all elements in the 0th row of H,(A) are equal 
to zero and the other row sums are less than 1. Hence, for any approximating 


II-chain or approximating [1,(A)-chain (x, x, £), if at time 6 the chain visits 0, 
i.e. x(d) = 0, then 6 must be the lifetime, i.e. 8 =ð. 


Write 
GD= ¥ [HY 4) 
n=0 ; _ 
中 ji 人 = Gi (AA T 4) : (5) 


Then P(A) = {ġ;{å) i jeE! is the Laplace transform of the Feller minimal 
solution f(D) = {f(D,i, jEE} (t>0). Because 42 P(A) <1, it follows that 
G{A) < œ and, therefore, all states in E are Tw-non-recurrent. 


Lemma 1. Assume that (y,0,6) is a I,(4)-chain with its initial distribution 
concentrated in E. Let 6(E) be the first exit time of the chain from E: 


O(E) = sup {n: y(n)4E, 0 < n < ô} 
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Then 
: ò fo= +x, orð < + 0, WHEE 
5(E) = | mie (6) 
0 一 1 ifô < +oo,yO0=0 


and (y,0, åE) is a H(å}chain. 


Proof. Since v(O)¢E. it follows that 0 < ôE). And since all elements in the 8th 
row of J1,(4) are equal to zero, the only possible time for the chain to reach 日 
is the lifetime 6 < oc. Hence (6) is justified. Because (y, 0,5) is a I,(7}-chain, it 
is clear that (y, 0, 6(£)) is a TI(4)-chain. The proof is completed. QED 


Lemma 2. Assume that (y,«,. 6) is an approximating [1,(A)-chain and that òE) 
is the first exit time from E, 


sup {ni WneE,acn<d} 


d(E) = | , (7) 
一 © if the above set is empty 
Then 
一 加 ifx = ô, y(d)= 0 
(F)=. 6-1 fea<d< +a, Wd) =0 
ls f= —x,oragd< + œ, y(O)EE 


and (y,x,ô(E)) is on approximating II(å)-chain on Q(E)=(— æ < ò(E)) = 
(— œ =a)U(—- æ <a, plajeE). 


Proof. Suppose the random times 2,|% and «, leads {y,x%x,ò) to a IMa(4)-chain 
(y,.0,6,) on Q, = {2,EN, «<a, SÔ} respectively. Restricted to Q(E)AQ,, the 
chain (y,,0,6,) is a ,(A)-chain with its initial distribution concentrated in E. 
On AE), let «,{E) = %,. Then on Q(F), x,(E}|« and for cach n, (E) leads the 
stochastic chain (y,«,6(£)) on Q(E) to the chain (y,,0,d(£}} on 0,(£) = 
{a,(E)EN, x < a (E) < ô}. Notice that Q(£E)0Q, = QE) and 6,(E) is just the first 
exit time from E of the 1,(A)-chain (y,, 0,6,) on Q,(E}. According to Lemma | 
the chains (y,,0,6,(£)) on QE) are all FI(/)-chains. Therefore (y, x, 6(£)) is an 
approximating T1(A)-chain on QE). The lemma is proved. QED 


In the following it will be pointed out that we can, if necessary, enlarge the 
measure space and always extend a [(A)-chain or an approximating II(4)-chain 
to a I-chain or an approximating II-chain. For this purpose, we first introduce 
the concept of conditional distributions and conditional independence about 
stochastic chains. We remark that ‘distribution’ in the following definition means 
a probability measure which is deduced from a random variable or a stochastic 
process on its path space. For example, the exponential distribution with the 
parameter q is the probability measure on the real line deduced from the 
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rn- ift<0 


distribution function 


] 一 e f ift >0 


Another example: the distribution of the II-chain starting from i is the 
probability measure on the infinite-dimensional space E x E x E x --- generated 
by the consistent family of finite-dimensional distributions {R(i,i,,i,,....i,)}, 
where 

RU, ii 一 Ma H; 


Definition 1. Let (Q, 7, P) be a measure space and «/ a Borel subfield of F. 
Suppose p, (n > U are F -measurable functions and F, (n > 1) are distributions 
on the real line. If for any Ae. and Borel sets B, (n > 1) on the real line, 


P(A, p,€B,,...,p,€B,) = P(A)F (Bi) F,(B,) 


we say that given .o/, p, (n> 1) are conditionally independent and have the 
conditional distributions F,,, respectively. 


Similarly, if a quasi-stochastic chain (z, £, 5) or a sequence of quasi-stochastic 
chains (Zm Ew» Ôn) (n = 1) are defined on (Q, F, P), we can state the definition that 
Wf, all p,, n> t, (z,€,d), (Zm En Ôn), n> 1, are conditionally independent and the 
definition that given .%, the conditional distribution of (z,¢,5) is some 
distribution, and so on. 


Lemma 3. Assume that ¢ is a finite FI(A)-excessive measure. Then there exist a 


measure space (Q, F, P} and an approximating IM,(å)-chain { y, 2, 8) defined on’ 


it such that if — œ < a then y(x)eE and, moreover, 


um | 2 CL y(n)] dP JEE (9) 
Q 


asns ė 


Proof. According to Theorem 9.4, there exist a measure space (Q,,.7,, P,) and 
an approximating I(A)-chain (y,,0,,0,) defined on it with the characteristic 
measure ¢. It is well known that there exist a probability space (Q,,.¥ ,, P,) and 
a family of independent random variables €,(i) (ic E), defined on it such that 
for each i, ¢,(i) take values 0 and 1 with probabilities 2/(4 + d;) and d,/(A + dì 
respectively, where d; is the non-conservative quantity of the state i. Take the 
product space (Q, F, P) =(Q, x Q,,F%, x Fa, P, x P,) and for w=(w,,w,)eQ 
let 

č(i, w) = ča(i, w2} 

ÒE, w) = 6,(w)) 


y(n, w) = y(n, Ww) 


a(w) = «,(w,) 


if x(w) < n < OE, w) 
if ôE) = + oo 


S= | 十 20 
5BEI+efy[5CE)]} if (E) < + œ 


weg. (8) 


a em mm i Pr rtd eA EE a a i ee A oar a 
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When o(£)< + co and €{ y[o(E)}} =1 put y(6)= 0. Then it is easy to prove 
that (y, a, 6) is what we require, and the proof is completed. QED 


Lemma 4. Assume that č is a finite FI(A)-excessive measure, Then there exists a 
measure space (Q,4,P) on which are defined an approximating II,(4)-chain 
(y,a,0), a sequence of quasi-stochastic chains (z,,0,g,) (ieE) and a family of 
F -measurable functions s,, weU, with U being a given subset of (— 20, + œ), 
such that 

(i) on (— ©, + 00), y,E£ and (9) is satisfied; 


(ii) given .% = F (y,a,ô) for each ueU the conditional distribution of $, is a 
given distribution F,; 


(iii) given .o, for each i the conditional distribution of (z; 0, ¢,) is the distribution 
of the II-chain starting from i; 


(iv) given ,%, all S,, ueU; (z,,0,¢), i€E, are conditionally independent. 


Proof. This can be verified by an application of Lemma 3 and the technique 
of making independent product spaces. QED 


Definition 2. Suppose stochastic chains (y, g, v) and (x, a, 8) are defined on the 
same probability space. If e=a, v <£ and for neN and e<n<yv, y(n) = x(n) 
holds, we call (x, x, 8) an extension of{ y, £, v} and ( y, e, v) the front part of (x, a, p). 


Theorem 5. Suppose that 4>0 is fixed and assume that ¢{2}) is a finite 
TI(A}-excessive measure. Then, there exist a measure space (Q, F, P) and defined 
on it an approximating I(A)-chain ( y, «, v) and an approximating TI-chain (x, a, £) 
such that (x, a, 月 is an extension of ( y, a, v). The characteristic measure of ( y, x, v) 
is ¢(2) and the characteristic measure of (x, a, f} is 


C= CMA FAL CAA + Gq) Gi (10) 


Proof. it follows from Lemma 4 that there exist a measure space (Q, F, P) and 
an approximating I1,(4)-chain { y, a, ô) defined on it such that 


(4) = 2 , CL y(n)] dP jeE 
Qesns 

Removing (— œ <a, (a) = 0) if necessary, we can always assume {— œ% <a, 
y(a) = 6} is empty. On (Q, F, P) we can also define a sequence of quasi-stochastic 
chains {z; 0, £;} (i€ E) such that given F( y, æ, ô) all (z,, 0, ¢,), ic E, are conditionally 
independent and for each i, given ¥(y,a,6), the conditional distribution of 
(z;,0, ¢;) is the distribution of the II-chain starting from i. 

Define the first exist time 6(E) of the approximating I1,{2)-chain from E 
according to (7). Abbreviate 6(E) = y'. Then Q=(— œ < y) = (2 < y} and (y, %, y) 
is an approximating [](A)-chain with the characteristic measure {(A). 
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Let 


p= 让 一 十 ooory = 一 6 一 1< 十 oo ay 
Y EEn ify=ð< +0 
For neN, x < n < $, define 
AH ny 
TE | (12) 


Zaal — 6) yotouoy<n<Zp 


Obviously, (x, a, £) takes its values in E and is the extension of (y,0, y). Next 
we will prove that (x, «, 8) is an approximating [-chain. 


First, suppose the approximating [1,(A}-chain (y,0,6) is a I,(4)-chain and. 


a=. We will prove that (x, 0, £) defined as above is a I-chain. That is, we 
prove A, = Ap- II. where igin- ih EE, n> 1, 


in- iin? 


A,, = P(x(0) = ip, ..., x(n) = i,) (13) 
Define R(ig,i,,...,i,) according to (8) and similarly define 
R(A; ips 1,...,in) = Morn OM (4 n ilh) (14) 
Note that 
(y0) = ip} <(O < 7) (y(n) = i) © (n < ô) c (n < ô) 
hence : 


A, = P(x(0) = io... x(n) = ipn < Y) + P(x(0) = ig,..., x(n) = in, y <n) 
= P(y(0) = ig,..., y(n) = ipn < ô) 
+ P( YO) = ig, ---, (8) = iz Zya (l) = ist 10-5 Zc — 6) = i, 5 <n) 
= P(y(0) = ig)R(A, ig, i,...,i,) 


n~1 
十 de P( (0) = io, y(t) = Bi ay JR) = i, 0 = k, zą(!) 
k= 


= ing yo (nk) =i,) 
By conditional independence, the summand in Er d is equal to 


P( y(0) = io. M1) = i,..., y(k) = ip, 0 = K)R(i,, les yo: "a in) 


= P(y(0) = ig )R(A; loosens | 一 2 Ti, (2) Ri 
jeEg 
Consequently, 


A, = P( y(0) = if Ri for tas +++ stn) 


‘= a 2 a A = 
+ 》 RFit 


k=0 fix 


SR 
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= P( (0) = io) RU io si), u (A) 


十 及 (io A+, JT, 
n-1 人 

十 > Ro sia + gn Rhio i i: 
k=0 


Noting 
I (4+ 444+ q,,) 0 


we find that A, = A,_ Ma i 
On the other hand, 


in-tin in -tin 


G=| È CxnjdP=| 5 Chama + | > C,[x(n)] dP 
OSnSB QNO<Asy y<+ Sns 
= C4) +) > CyLz(n)] dP 


i <+% QO<ndz; 


By conditional independence the summand in È is equal to P(6 < + œ, W(d)=i)G;;, 
and 


: +n i +x À 
Pò < +œ, vO)=i)= F Pion =ið=n= 了 Oe 
n=0 n=0 1 


= AC (AMA + q) (15) 


Therefore (10) is verified. 

Now suppose that (y,2,0) is an approximating I1,(A)-chain and that a, ]o 
and a, leads (y,%,6) to F1,(A)-chains (y,,0,6,) respectively. Suppose a, leads 
(x, x, B} to (x,,0, Ba) for each n. Let y be the first exit time of (y,%,6) from E. 
Just as we have defined the extension process (x, «, 8) of (y,a,y) from (y, a, ô) 
and (z,,0,¢,) (i¢ £) in the fashion of (11)-(12), for each n we define the extension 
process of (y,,0,y,) from (y,,0,6,) and (z; 0, 8;) (eE) in the fashion of (11)-(12). 
Here y, is the first exit time of (y,,0,6,) from E. Then this extension process is 
just (x,, 0, B,). Since, given F ( y, a, ô), (z; 0, 50) (ie E) are conditionally independent 
and the conditional distribution is that of the II-chain starting from i, it follows 
that given ¥(y,,0,6,) the same assertion remains true. From what we have 
proved, (x,, 0, 8,) are [¥-chains. Therefore (x, «, 8) is an approximating [-chain. 

Let ¢” and {"(A) be the characteristic measure determined by (x,,0, 8,) and 
(yn: 9, Yn) respectively. Then we have proved that 


C= GHA + ADL CAMA + a) Gy 


Since ("7¢ and ("(4) 7 ¢(A), (10) follows. And the proof is completed. QED 


308 EXTENSION OF PROCESSES 
11.12 @ PROCESS ON A MEASURE SPACE 


We will extend the concept of denumerable Markov processes defined on a 
probability space to that on a measure space (Q,¥,P). Write T for [0, + æ) 
or (0, + oc). Suppose that E has the discrete topology. Let E = Eu {œ} {oo¢E) 
be the one-point compactification of E. 


Definition 1. Let (Q,4,P) be a measure space and o be an ¥-measurable 
function valued in [0, + œ). Assume that for every fixed teT and almost every 
we{t<o},x(t,@) is defined an takes a value in E. If for any teT and iek, 
P(x(t} = oc) = 0 and, moreover, 


A(t, i) = (x(t) = ) = (w:x(t,w) = i, t < olo) eF (1) 


we call X = {x(t), te T A[0,¢)} a quasi-random process. If P(A(t,i))< + œ for 
every teT and ieE we say that X = {x(t), teT O[0,c)} is a random process 
and that the minimal Borel field containing all A(t, i} (teT, ic E), denoted by 
F(X) or F{X(t), teTo[0,o)}, is the Borel field generated by X. When 
T=(0, + œ), a random process X = {x{t), 0<t< 6} is said to be open. 


Definition 2. Let P(t) = (p,,(t), i je E), t > 0, be a standard generalized transition 
matrix and assume X = {x(t}, te T > [0, i)i to be a random process. If for any 
nl, toET, to<t <--> <t,4, and ip, i,,...,1,4,6E, 


P{xt{t0) = io,... 


we call X a Markov process with the transition probability matrix P(t). X is 
called a Q process if the Q matrix of P(t) is the matrix Q. X is ae to be a 
minimal process if P(t) is the minimal solution. 


,X(t +1) = int) = P{x(to) = ig,--.,X(t,) = in)Pinin+ 1(fn+1 Sy t,) (2) 


Theorem 1. Let X = {x(t), teT ^ [0,0)} be a Markov process with the transition 
probability matrix P(t). Suppose S is an ¥ -measurable function and given F (X), 
its conditions distribution is the exponential distribution with parameter |. For 
A> Olet p3(t) =e “pi(t) and o(A) = min (6, S/d). Then X* = {x(t), te T AO, o(A))} 
isa Markov process with the transition probability matrix P4(1) = (pi(t ) i, jE). 
In particular, if X is a minimal Q process, then X? is a minimai Q(A) process. 


Proof. It is easy by making use of the conditional independence. QED 


Lemma 2. Given a totally finite measure v = (v,,ic E), there exist a totally finite 
measure space (Q,.¥, P), a II-chain (x,0, 8) and F -measurable functions p? 
(n > 0, ic E) defined on it, such that the initial distribution of (x, 0, f) is v; given 
F (x, 0, p), all p} (n > 0, is) are conditionally independent, and for each i the 
conditional distribution of pẹ is the exponential distribution with the parameter 


Fi: 
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Noting the above, the characteristic measure of (x, 0, 8) is € = yG while vG is 
not necessarily finite. So Lemma 2 is not a direct corollary of Lemma 11.4. 
Since v is totally finite, it follows that with the aid of the ordinary existence 
theorem for Markov processes, there exists a -chain that is defined on a totally 
finite measure space and has the initial distribution v. From this, imitating the 
proof of Lemma 11.4, we can prove Lemma 2. 

The following theorem follows immediately from the construction of minimal 
processes. 


Theorem 3. Assume that v, (x,0,8) and pf (n20, ieE) are the same as in 
Lemma 2. For 0 <7 < $, let p" =p To =Q, Ta = Dig p and o = tr. For 
O<t<a, let 


X(t) = x(n) 


Then X = {x(t), 0 <t <c} is a minimal Q process. 


Pusia ni (3) 


Similarly the following Lemma 4 and Theorem 5 are also clear. 


Lemma 4. Assume that v = (v, i€ E) is a totally finite measure. Then there exist 
a totally finite measure space (Q, ¥, P) and defined on it a I,{4)-chain (y, 0, ô) 
and #-measurable functions p°, p? (n > 0, ic E) such that the initial distribution 
of (y, 0, ô) is y. Given F (y, 0, ô) all p°, p? (n > 0, ie E) are conditionally independent 
and, furthermore, the conditional distributions are exponential distributions 
with parameters À and À + q; respectively. 


Theorem 5. Assume that v, (y,0,6) and p°, p"(n 20, ic E) are the same as in 
Lemma 4. Let 6(E) be the first exit time of the I1,(4)-chain (y, 0,6) from E. For 
O<n< o(E), let 


P" = Prom ro 一 0 Zn+l HAN 
"+ oc 
p if (E) = +œ 
g= i=0 
Taes if 6(E) < +% 
+ : 
pi if 6(E) = 
i=0 
Og 一 ; 
aire if (E)=d< +0 
Tarti +P? i{6(E)=6—1<+% 


For 0<t < az, let 


X(t) = y(n) 


tt 
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Then X = {x(t),0<t<o} is a minimal Q(A) process and X= {x(t),O<1t < ca} 
is a minimal Q,(A) process. Their initial distributions are all y. 
11.13 APPROXIMATING MINIMAL CO PROCESSES 
Recall that E is endowed with the discrete topology and is compactified by the 


one point ‘oc’. Let finite sets D, c E and D,T E as nt oo. 


Definition 1. Assume that 0 < o < + œ. A function X = {x(t),0 < t < o} defined 
on [0, ø) is called a jump function of type U if the following conditions are 
satisfied: 


{i) x()EEU {oc}, x(theE (0 <t <a) and X is right-continuous; 


(ii) for any [c,d] <{0,0), X has only a finite number of jump. points in [c,d]; . 


üii} for any ie E and any de(0, a), X has only a finite number of i intervals in (0, d). 


Definition 2. A random process X = {x(t), 0 < t < ø} is called an approximating 
minima! Q process defined on a measure space (9, Z , P)iffor any t > OandicE, 
(x)= DEF PxX(th=)< +a 
and the following conditions are satisfied: 
(i) Equation (12.2) holds for 0<tg<ty <+ < tas pio lis.. 
P(t) is a minimal solution P(t). 
(ii) All paths of X are jump functions of type U. 


(iii) There exists a sequence of [0, + 00 ]-valued random times t, J0 such that 
X,={X(t,+0, O<t<o-—t,} is a minimal Q process defined on 
Q, = (t, < o} and that the support of the initial distribution of X is contained 
in D, 


. 144,68, where 


Note that a minimal Q process is an approximating minimal Q process. In 
this case, t, may be taken as 0 or as the hitting time at D,. When we consider 
the restriction on Q = (e = 0)u (e > 0, x(0) ¥ 00) of the approximating minimal 
Q process, we see it is a minimal Q process. In particular, if P{x(0) = œ} =0 
the approximating Q process X is just a Q process. If we still work on (Q, F, P) 
but restrict the parameter set to (0,00), then X’ = {x(t),0<t<o} is an open 
minimal Q process. However, an approximating minimal Q process may not 
necessarily be a minimal Q process because for an approximating minimal Q 
process X = {x(1),0 <: < a}, the measure of the set {x(0) = œ} may be infinite 
although it is #-measurable. But if P(x(0) = oc) =0, then an approximating 
minimal Q process is precisely a minimal Q process. 


Definition 3. Assume that X = {x{t),0<t<o} is an approximating minimal Q 


一 
~ 
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process. Let 


nar | [Goa 2>0, jeE (1) 
n= | | C,[x(t)] dP jek (2) 
vO 


We call y the characteristic measure of X and (A) its 4-characteristic measure. 
Theorem 14.3 will prove that ((A),A>0) is an entrance family (see 
Definition 2.11.1). So we call it the characteristic entrance family of X. 


Theorem 1. Suppose Tu are a sequence of random times which are given in the 
definition of the approximating minimal Q process X = {x(t),0 < £ < a}. Suppose 
for each n, t, leads X to a minimal Q process X,= {x,{(t),0<1<o,} on 
Q, = (T, < 0). Then on Q for any tefo, o), 

lim X,(t)= X(t) 


n= + oe 


te{0, a) (3) 


Proof. Since t, }0, o, =o — t, fa. Then by the right-continuity of X, for te[0, o) 
we have 


lim X,(t)= lim X(t,4+9= X(t) QED 


n> +x n> +w 


11.14 ENTRANCE FAMILIES AND APPROXIMATING 
MINIMAL PROCESSES 


Fix 4> 0. Assume that a totally finite measure n(A) satisfies the inequality 
Au—uQ>0 (1) 

Then €(2)=9,(4)(A+q,) is a finite TI(4)-excessive measure. According to 

Theorem 9.4, there exist totally finite measures vw"(4) such that: 

(i) the support of v"(A) is contained in D,; 

(ii) v"{A)G(A)T CA) as nf oo and (v"(A)G(A)); =F, JED, 

(iii) for m<n, the hitting distribution that the M(A}-chain with the initial 

distribution YA hits D,, is v(A). 

Note that (ii) is equivalent to 


v"(A\P(A) T (A) nf +o 


2 
(DAA); = 14) jeD, i 


Theorem l. Fix A>0. Assume that the totally finite measure n(2) satisfies (1). 
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Then there exist a measure space (Q,.¥, P) and an approximating minimal Q,(A) 
process X = {x(t}, 0<t<a(0)} defined on it, such that: 


(i) if we let t, be the hitting time of X at D, then 1, leads X to the minimal 
Q,(4) process with the initial distribution v"(A) for each n; 


(ii) 


mie) 
nj(A) -| | C,EX(t)}dtdP jek {3) 
NO 
P(X(0) = 8) =0 P(x(0} = i) = (41) (4) 
where 
v(A) = An{A}n(AyQ (5) 
Particularly, if 7(A) is the solution of the equation 
Au—uQ=0 (6) 


then x(0) = co almost surely on Q. 


Proof. Because €,(A) = 4,(A)(A +q) (JEE) is a M(A)-excessive measure, on the 


basis of Lemma 11.4 there exists a measure space (Q,4%,P) on which an 
approximating I1,(4)-chain (y, x, ô) can be defined such that 


P(— œ <4, yla) = 8)=0 P(— œ < 4, p(a} = i) = ¥,(A) 


and on (一 co = a) almost surely 


lim y(n} = co 


and 


CA) -| > CtymldPp jek (1) 
NQasnsð 

and the hitting distribution that the chain (y, «, ô) hits D, is v"(A). On (Q, F, P) 
a family of Z -measurable functions pe and py (n > 0, ie E) can also be defined 
such that given F (y, «, 6), all pa, p” (n >O, ic E) are conditionally independent 
and the conditional distributions of pe and p? are exponential distributions with 
parameters 4 and / + q; respectively. Let 6{E) be the first exit time of the chain 
(y, 0,6) from E. Then (一 oo < E) =(a < HE) =Q. If a<n< dE), we let 
P” = Pmp and if (E) = 6 — 1 < + œ, we let p* = pe. Then we proceed to prove 


| $ p"dP< 十 oo (8) 
a 


aeons 


In fact 


2 paP=), pndP + psdP 
fakasd neN ene y ERER 
asas ðE) OE} =d~-1< + 00 
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By conditional independence the first part of the above formula is equal to 


ys | prdP= 2 2 POMS +a) = 2 Pola) S= iA 
neN ieE J y(n) =i neN icE feE nen 
=} GAA) |= dL nA) +o 
icE icE 


By a deduction similar to (27) the second part is equal to 


a pedP = P(O < + œ, y(6)= 的 ?1 
(8) =8 
= 1!) P(S(E) < + œ, y(G{E)) = i, WHE) + 1) = 8) 
ic E 
=A7!Y P(E) < + %,y(6(E)) = NM 9(A) 


icE 


一 4 1 AC {ANA + a)” “lA 


ieE 
= > ni(2)Mia(4) < 2 nA) < + oo 
ief iek 
Now we define X = {x(t},0 < t < o(0)}. Let 


t=0 Tn = p“ (a<n <ò) (8) =T3+1 (9) 


For 0<t < a(@) let 


x)= y(n) ity << teat 


l 
x(0) = co if —wo=4 (10) 


We shail prove that X = {x(t),0 <1 < o(6)} is what we want. 

First, (4) is clear. For each path of X, (i)—{i1) in Definition 1 hold (substitute 
E, for E). From (7)and ¢ {A} < + co we have almost surely $. <,<5C;Ly¥)] < + œ. 
Hence condition (iii) in Definition 1 also holds. Therefore the paths of X are 
all jump functions of type U. 

Next, for jeE, (3) follows from 


39) 
| cioar = | > CLy(n)]Jp"dP 
2 


0 OQasnsd 


m | E C,Lyn)]otaP 
£ 


Yn 


=}, pr dP = > P(y(n) = jA +q; 


neE J y(n) = j 


= CAAA T q)? = nA) 
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Moreover, for each n let x, be the hitting time of the approximating 
TI,(4)- chain (y, «, 6) at D,. Then the hitting time of X at D, is 


于 ifa < 十 o0 
+ DC ifa,= +x 


Suppose for each n, a, leads (y, 2, ô) to the I,(A)-chain (y,, 0, ôn) on Q, = (a, < 6). 


On Q, let o, = 0(0)—b, and x,(t)=x(b, + t) for O<t<o,. Then X,={x,(t), . 


0<1<o,} is a Markov chain defined on Q, with the initial distribution v"(A). 
As a, is a random time of the chain (y, «,6) which is independent of the future, 
given F(y;,,0,6,), p°, p” = p7 +" (m > 0, ic E) are conditionally independent and 
given ¥(y,,0,6,) the conditional distributions of p° and p?” are exponential 
distributions with parameters 4 and 4+ q; respectively. In the fashion of 
Theorem 12.5, from (y,,0,6,) and p°, 57 (m > 0, ic E) we can obtain a minimal 
Q,{4) process that has the same initial distribution as (y,,0,6,). This minimal 
Q,(A) process is none other than X,. But (a, < + co) = (b, < o(@}), hence for each 
n, X „is a Qe) process defined on Q, = (b, < o(@)) and the support of the initial 
distribution of X, is contained in D,,. 

Finally we are going to prove that (12.2) holds for O<t,<t, < .<tr1io, 


i,,.--54,4,€£ and the minimal solution P(t) = (540, i, je Eg) to the O matrix 


Qå). 

In fact, x, | a since y(x)EeE on ( — œ <a). Hence Q, = (a, < + «)TQ. Since on 
Q, o(8) < + œ, it follows that b, = 1, |0 and so o(0) — b, f o(@). Therefore for ail 
telO, o(@)), x,(t) = x(b, + t) > x(t). Hence 


(x(10) = io;..., Xin) = Jm = lim 22, 0(X alto) = ios- X alba 1) = im) 


n> + 00 


so that 


P(X (to) = io,..., X (fmt) = imt) 
= lim P(Q,, X (to) = tos. +> Xaltims1) = in+1) 


n= + 00 


= lim P(Q,, X,(to) = ig) Di, (ts = to) P? 


imlm+ 1 


(tm+1 > tm) 


n> +o 


= P(X(to) = i) P4; (ti — to) P? ari ta) 


imim+ i 
Thus, X = {x(1),0 <t <o(6)} is an approximating minimal Q,(A) process. The 
proof is terminated. QED 


The following theorem is obvious. 


Theorem 2. Fix à > 0. Assume that X = {x(t}, 0 < t < o(@)} is an approximating 
minimal Q;(4) process. Define y;(å} (je £) according to (3). Let o{E) be the last 
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exit time of X from E, that is, 


oE) = sup{t: 0 < t < o(f), x(theE} 
l= ifthe above set isempty 


(it) 


Then X; = {X(t),0 <t <o(E)} is an approximating minimal Q(A) process which 
is defined on Q(E) = (— œ < o{E)) and has the A-characteristic measure n(A). 


Theorem 3. Assume that (4(A), 4 > 0) is an entrance family and the number u > 0 
is fixed. Then there exists a measure space (Q,.4, P) on which are defined an 
approximating minimal Q(z) process Y = {y(t),0 <t <o(E)} and an approxi- 
mating minimal Q process X = {x(t),0<t < e}, such that: 


(i) X is an extension of Y, i.e. o(E)<o and y(t) = x(t) for te[0, o(E)); 

{fi} P{ (0) =i} = P{x(0)=i} = v; ieE; in particular, if v = 0, then (0) = x{0) = æ 
almost surely; 

(iii) for each n, let t, be the hitting time of Y at D,, then 1,40 (nf + œ) and Th 
leads Y and X respectively to a minimal Q(x) process Y, and to a minimal 
Q process X, on Q, =(t, < + 00), which have the same initial distribution 
(A); 

{iv) the characteristic measure of Y is y(x); 

(v) the characteristic entrance family of X is (y(A), A > 0); 


(vi) the characteristic measure of X is the standard image of (n(A), A > 0} (see 
(2.11.9)). 


Proof. From Theorem 1, there exists a measure space (Q, 4%, P) on which can 
be defined an approximating Q(x) process Y, = {y(t),0 <t <o(0)} such that 
P{ (0) = 6} =0, P{y(0) = i} = v; and, moreover, 


ai) 
n=| | Cily) ]dedP JEE (12) 
QJ0 


By the technique of independent product spaces, we can also suppose that on 
(Q,¥,P) a family of quasi-random processes Z;= {z(f),0<t<e,} (i€E) are 
defined such that given ¥(Y,), all Z, ic E, are conditionally independent and 
for each i the conditional distribution of Z; is the distribution of the minimal 
Q process starting from i. 

Let o(F) be the last exit time of Yo from E. Then, clearly Y = {y(t),0 < t < of E)} 
is an approximating minimal Q(A) process and the characteristic measure of Y 
is y(x), i.e. (iv) holds. 

Let 


T on if o(E) < a(@) or o{E) = 十 oo (13) 
“ol en if o(E)=0(0)<+% 
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For 0<1<o, let 
X(t) = es if 0<t<o(E) 
Z watz) ~ ot ~ 0(E)) if o(E)= (< + œ% 


a(E)<t<a. 


(14) 


Then X is an extension of Y, ie. (i) holds and so does (ii). Suppose the 
characteristic measure of X is 7. Then 


-| | ceoawey 
Rvo 
o(E} 
-| [Pernas] 
02 


| Cj LZ ace) olt — O(E)) dt dP 
0 a(E) = (9) < + 2 
=njlu) + 2 

ieE 


al E} 


o(E}=a(3)< 十 op 
y{o(E)) =i 


| crznaea 
0 


By conditional independence and (11.5) the above is equal to 


nl) + 2 PO(o(E)) = i, o(E) = 
ick 


=n (4) + 2 P(y(o(@)) = ÐT; 


o(0) < + oM; 


nie) + ed nE; 
fer 
This is just the standard image (2.11.9) of (1(4), A > 0) and so (vi) is verified. We 
now prove claim (iii). For each n, let t, be the hitting time of Y at D,. Then 
t,)0. Suppose t, leads Yp, Y and X respectively to Ye, Y, and X, on 
Q, =(t, < + œ). By Theorem 1, Y, is a minimal Q(z) process with the initial 
distribution v"(4) for each n. Clearly, X, ts an extension of Y, and, furthermore, 
they have the same initial distribution. Hence if we can prove that X, (n> 1) 
are minmal Q processes, then X is an approximating minimal Q process. 

Just as we obtain X from Y, and Z; (ic E) in the fashion {13)-(14), on Q, we 
can derive X, from Y,, and Z; (iek) in the same fashion. Hence we need only 
prove that if Y, is a minimal Q,(4) process, then the process X obtained in the 
fashion of (13)--(14) is also a minimal Q process. Notice that under the above 
hypothesis y is a minimal Q(/) process. 


For ioii- -sip EE and 0<tyg<t, < <t assume that 


k 
A, = Q (vt) = i) 
j=0 


We are to prove 
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R,(i u} = È Z —~uy=i,0<t,-u<e) 
ink 


Prp = PAP. i, (tea — te) (15) 


Clearly 
P(A 34) = Angi + Beye Cnoi (16) 


where 
Ans 1 = P(A 1 t+1 < o(E)) 


Bava = P(A,+ 1 O(E} < to) 
Cn+ 1 = È P(t te < OCF) S ty. 3) 
k=0 


It follows that 
(Ansistns1 <O(E)) = (Ant o fnri < OE) = Ans 
Aga, = PlAgs1) = P(AgP} i, (tn+1— tn) 
= ApPinine (trea — a) EXPL ~ Mtn+ 1 — ta) ] (17) 


By conditional independence 


Bra = 2, P(v(a(E) — 0) = i, Roli, o(E))) 


ick 
to iz 
| Pi (ti — to): Pio (n11 — ts)duP(y(o(E)— 0) 
i vO 


= i,0{E) <u, Zi(to ~ a(E)) = ig) 
fo A 
-zÍ Pini (ex — fod Pi, siglln — 
i Jo 


= i, o(E) < u, Zi(to — o(E)) = iP ia, eit) 
= BP... (Gig = t,) 
By a similar calculation we have 


P(A, 4 15 be < o(E)< Ce + 1) = 


t,—1)du P(y(o(E) — 0) 


P(A,, ty < G(E) S ee | em (es =.) 
so that 


Cie =C E TEE (ore — ty) + P(Ans tn < OIE) S thy 1) 


Therefore, to prove (15) it suffices to verify 


P(A gs i tn < O(E) S tnt 1) = AnP inin (tne — to){l ~ expE— Alne — tad} (18) 
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Note that 
Lu = P(yo(E) — 0) = i110) = k) = Ad I? Were 
+x 
ae > ma 人 1 = 2 m0 ) =A,). i Pi (Ò — ude” ™P,, (u) du 
m= jeEe i i JO 
Ta SSE ô 
= Gul +q) A= Ad,dA) = a| e`“ P,(t)dt = arf 2e- P (8) du 
0 - nin+ t 
and . 
Lalu) = P(y(o(E) — 0) = i, 0(E) <ul (0) = k) =e 
ju) = P(y(o =i, 
t 1 i‘ = Hence, (18) is proved 


= Lu — 2 P(y(u) = l, u < o( E), y(a(E) — 0) = i| (0) = k) We now prove claim (v). To begin with, suppose X is a minimal Q process 
ea: with the initial distribution v. Then 
= Lyi - 3 Pw Ly 


: o 十 名 
i . | | | e~*C,[x(t)]dtdp = | e| Ci[xDJjdPdi 
But Ne O 0 <a 
u P = f 
> PA(u)L;; 一 £ eB | e “P(t)dt | = | e "2, v,P(t)dt 
leE leE 0 | 0 : 
Ta ES =) Yby) = Evola]; 
= af e 4“ FOP, (u + t)dt 2 i : 
Now suppose X is an approximating minimal Q process. Then 
= :| e “Pp, (Ddt Gn 
u | i. e~*C,[x(t)]dtdp = lim | | e *C,[x,(t)]dtdp 
上 一 十 ox fanw O 


= lim [COd(4)] 


as + o 


so that 
L,(u) = a| e “P, (t)dt | 
0 
But by the resolvent equation for (A), 


P(A) = plu) + (u — ipl npl) 
and by (2), we have 


dLylu) = 2e 7 * P (u)du 
Abbreviate 6 = t+; — tẹ» By conditional independence, 
P(An+ ifa < O(E) S t+ 1) 


=¥ P(A, .,.(o(E) —0) = i,t, <o(E) <t,,,) DAA) = "UDA + u ODOD > nlu) + (u — An) P(A) = nl) 
f Therefore (v} is proved. Thus we conclude the proof. QED 
= È PAn VOCE) — 0) = i, Zlin +1 — OED) = ins ts < OCE) < tns 1) 
R 11.15 APPROXIMATING MINIMAL CO PROCESSES ON A 
= | Pig. (tn — u)du P(A, yo(E)— 0) = i, o(E) < u) TOTALLY FINITE MEASURE SPACE 
ome uf Recall Definition 8.5.1. Let (1(2),4 > 0) be an entrance family. If 
=) | Pins (trv — udu P(A, JL, (uty) | lim MDE= M< +0 (1) 
l vin A> +o 
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where #(A}! = 3°44}, we call (n(A), 4 > 0) a non-sticky entrance family. When 
M < | the entrance family is said to be probabilistic. 


Theorem 1. Assume that X = {x(t),0<t<o} is an approximating minimal Q 
process defined on the measure space (0,¥,P) and for each 2>0 the 
A-characteristic measure of X is 4(A). Then (4(A), 2 > 0) is an entrance family. 


Proof. Imitate the proof of Theorem 2.4.3(v). QED 
Theorem 2. Assume that X = {x(),0<1t<o} is an approximating minimal 
Q-process which is defined on the totally finite measure space (Q, Z, P} and has 
the characteristic entrance family (4(A), 4 > 0). Then (x(2),4 > 0} is a non-sticky 


entrance family. If (Q,.4%, P) is a probability space, then (#{4),2 > 0) is also a 
probabilistic entrance family. 


m= | ("Ze *arap 
NYO 


=| (1 一 e *)dpt pio > 0)< +œ AT oo (2) 
>00 


Proof. 


Theorem 3. Assume that (n(å4), 4 > 0} is a non-sticky entrance family. Then there 
exists an approximating minimal Q process X = {x(t},0 <t <o} defined on a 
finite measure space (Q,.4,P) and its characteristic entrance family is just 
(nfà), A > O). 


Proof. From Theorem 14.3, there exist a measure space (Q, ¥, P} and defined 
on it an approximating minimal Q process X, the characteristic measure of 
which is precisely (y(4),A>0). By the non-stickiness and (2) we have 


Pig >0} < co. removing {o = 0), we can assume that Q = {a > 0). Therefore . 


(Q, ¥, P) is a totally finite measure space. QED 


Theorem 4. Assume that (4(A),A > 0) is an entrance family (correspondingly, 
probabilistic entrance family). Then there exist a measure space (corres- 
pondingly, probability space) (Q, 7 ,P) and defined on it an approximating 
minimal Q process X = {x(t), 0 < t < a}, such that 

P(o >0)= lim An(A)1 (3) 


A> w 


Q 
= f e *C[x(t)]dtdP 
Tuw 


= i e` Ht) dt i>0 (4) 
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where 
H(t) = P(x() = j) 120 (5) 


is the inverse Laplace transform of 17;(4), 4 > 0. Suppose the Riesz decomposition 
of (n{A), 4 > 0) is 


n(A) = apii) + HD (6) 
Then 
= P(x{0)= i} P(x(0) = oc) = lim 4704)1 (7) 


Ata 


Proof. We need only to prove the second equality of (7). In fact, 


P(x(0) = 20) = 1 — X PO = i) 
= lim MD lim avd(al 
>+ A> 十 加 
= lim AHAI (8) 
站 一 十 om 


11.16 PATH STRUCTURE OF NON-STICKY RETURN PROCESSES: 
DV-TYPE AND (DV)*-TYPE EXTENSIONS 


In this section we assume that the minimal solution (p;{t)) determined by a Q 
matrix Q is stopping. Let X = {x(t),t < } be a minimal Q process defined on 
a probability space (Q, F, P). Then 


L{t) = P,(6 SIS ls DP.) (1) 


RAt) = PAG <t, (6 —0) = w) (2) 


are determined uniquely by Q, where P,(} = P{-|x(0} = i}. 
In the following we always assume that (x(4),4 > 0) is a given probabilistic 
entrance family and Hi} is the inverse Laplace transform of (4,4), 4 > 0). Let 


nes ee | ift<0 
Hi) =) HA H°(t) r HR 
H"*! = H"»+H 
M,= È (hin (3) 
P(t) = Pi, + | H(t — s} dM i(s) {4) 
0 


Here * represents convolution. 
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Lemma 了 There exists a probability space (Q, 4, P) on which can be defined 
a minimal Q process X° = {x%(t),0 < t < a°} and a sequence of approximating 
minimal Q processes X” = {x"(t),O<t<o"}, every X” {n 2 1) having the same 
characteristic entrance family (#({4), 4 > 0). They have the following properties: 


(i) (0, =OsU(a, = + 00) c(o,,4, = 9). 
(ii) Write A, =(0<6,< +00), Q,=(¢,>0), P(Q,.,|A,)=M, where M is 
determined by (15.1). 


(iii) Given A, or 2,,,, all X" (m<n) and X” (m2n+ 1) are conditionally 
independent. 


Proof. Imitate the proof of Lemma 2.1. 
Theorem 2. For X° and X” (n > 1) in Lemma 1, let 


n + 
i =0 ee Ei (5) 
m=0 m=O 
For 0<t<a let 
X(t}= X"(t— 1") "ae eo oa (6) 
Then X = {x(t}, 0 <t <a} is a Markov process and its transition probability is 
given by (3). . l 


Proof. Imitate the proof of Theorem 11.2.2. 


Remark ! 


Taking Laplace transforms on both sides of (4) we obtain 


Wi) = pH ZA -一 (7) 


where 


ZA) = 1 —Ag(a)l 


Remark 2 


When Q is conservative or (4(A), 4 > 0} is a harmonic entrance family, the process 
X in Theorem 2 is a Q process. But in general it may not necessarily be so. 


Remark 3 


The Markov process X in Theorem 2 is called a DV-type extension of the 
minimal Q process X°. Suppose the Riesz decomposition of the entrance family 


a ee rere hs yt re en O tt ra ep PP UE a it i Af rer yeh Pe 


PATH STRUCTURE OF NON-STICKY RETURN PROCESSES 323 


{n(A), 4 > 0) is (15.6). When (å) = 0, the DV-type extension of X° becomes the 
D-type extension in section 11.2. When « =Q, we call the DV-type extension 
the V-type extension. In this case, the leaping intervals of X, except the first 
one, are all „U intervals. 


Lemma 3. Assume that for some ic E and t > 0, R(t) is given by (2), and R,(t) > 0. 
Then there exist a probability space (Q,4%,P) and defined on it a minimal Q 
process X° = {x°(t),0<t<o°} and a sequence of approximating minimal Q 
processes X” = {x"(t)O<t<o"},n2>1, every X" (n21) having the same 
characteristic entrance family (4(A), A > 0). They satisfy the following conditions: 
(i) (o =OU(e" = + wo)U(X"(o" — NEE) c(o"*! =0),n > 0t. 
{ii} Put A, =(O0< g" < + œ, X"(o" — 0} = œ), Q, = (c, > 0). Then 
P(Q, lån) = M 

where M is determined by (15.1). 
(ij Given A, or Q,,,, all X” (m<n) and X” (m2n+ 1) are conditionally 

independent. 


Proof. Follow the proof of Lemma 2.1. QED 


Theorem 4. For processes X° and X" in Lemma 3, define X = {x(t),0<t<a} 
according to (5)-(6). Then X is a Q process with transition probabilities 


Pit) = Pit) + | H (t — s)dN (s) (8) 
0 
where 
+m 
N;= > (Ri* H") (9) 
r=0 
Proof. Imitiate the proof of Theorem 11.2.2. QED 
Remark ! 


Take Laplace transforms on both sides of (8) to obtain 


ay o 
WilA} = Bid) + C(t) IM 4m (10) 
where ¢,(4) are the Laplace transforms of R,(t), i.e. 
ECA) = 1 — Ad(A)l — plâd (11) 


where d= — QI]. 


‘when g” = 0, x"(o" — 0) are not defined. 
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Remark 2 


The first leaping point t of X in Theorem 4 is just co and if x is determined 
by (15.6} then 


Ci if ic E, 12 
P(X(t)= ilt <œ, X(t—-O)= = 4 Jim HH ifi=o V9 
Atta . 
P(o =rt|t< x, X(t-OJ=xa)=1-M 


P(o =7|X(t —OEH,)=1 


where H, is the set of non-conservative states, and as long as the above 
conditional probabilities are meaningful. 


Remark 3 


The Q process X in Theorem 4 is called a (DV)*-type extension of the minimal 
Q process X°. The (DV)*-type extension preserves the Q matrix. As in Remark 3 
after Theorem 2, when (4) = 0, the (DV)*-type extension becomes a D*-type 
extension. When 2 = 0, the (DV)*-type extension is called the V*-type extension. 
The D-type and D*-type extensions, generally speaking, are different extensions, 
but the extensions of type V and type V* are the same. Therefore, we only use 
the phrase ‘the V*-type extension’. 


11.17 GENERALIZED DV-TYPE AND GENERALIZED 
(DV)*-TYPE EXTENSIONS 


We keep the hypotheses and symbols used in the beginning of section 11.5 to 
(5.2). Write A,= HU B.. Denote by &, the class of all Borel sets in A,. For 
LAT, t) and har A) given in (5.1)-(5.2), we have lim, L(I, t) = lim, joh; 1T, A). 
Denote this limit by hD). 

Suppose we are given a mapping G(-,-) from A, x 2, to [0,1] satisfying: 
{1) for each ae A,, Ga, *) is a measure on #, and G(a, AJ) <l; 
(ii) for each Te #,, G(-,T) is a -4.-measurable function. 

Suppose we are also given a mapping from A, x (0, œ) to the Banach space 
i satisfying: 
(i) for each ae A.. (y(a, A), A > 0) is a probabilistic entrance family: 
(i) for each 4 > 0,(-, å) is a measurable mapping from A, to l. 


Let H (a, t} be the inverse Laplace transform of y io A), A > O. Set 


W(a,T SA We JAT) (1) 


tt 
epee cP E E 
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By Lemma 2.11.4 there exist limits 


Wa, T, DT W(a,P) At om 
Let 
Cla, T, 1) = Wa, F) — ~ LH a,t)h (2) 


The following lemma illuminates the probability meaning of W(a,T) and 
C(a,T, t). 


Lemma 1. Fix some aeéA,. Assume that the characteristic entrance family of the 

approximating minimal Q process X = {x(t),0<1<o} is (n(a, À), A > 0}. Then 

. P(X(o — 0)eT) = W(a,T) (3) 

P(X(o — O)EF, o <t) = C(a, IF, t) (4) 

Proof. According to the note after Definition 13.2 we know that {x(t}, 0 <t <a} 
is a minimal Q process. Hence 


P(t <a, x(o — 0er) = 2 P(X(t) =j,t<o,X(o—O)er) 
= ba H (a, t)h (T) (5) 


Then letting t }0 in the above we obtain 
P(X(o —OjeT) = lim }_ H fa, HAT) 


IlO j 
= lim aÈ ni na, åh (T) 
Ar D 
= lim W(a,T, 4) = W(a,T) 
Awe 
Therefore (4) follows from (3} and (5) and we conclude the proof. QED 


Remark 
When (n(a, A), A > 0) is a general (i.e. probabilistic or non-probabilistic) entrance 
family, Lemma 1 also holds. 


Let 


F(a, I,A} = | e “Cla,T,dt)= af e *C(a,T, edt (6) 
0 


0 


By (2) we have 


F(a,T, 4) = Wa, T)— W(a,T, å) (7) 
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Define 
LTD)=L(T,t) (see (5.1)) (8) 
ero=| | | G(a, db)C(b, T, t — s)Lř{da, ds) (9) 
Ov Ac Ae 
KT. t= > Berry) (10) 


Pit) = fii off | G(a,db)H; (b,t—)K j(da, ds} (11) 
Ov Aed Ae 


where (f;;(t)) is the minimal solution. The above P{t) = (oo) i is determined 
completely by Q, G(,:) and n(-,-). 


Considering Theorem 15.4 and using the technique of independent product 
spaces, we can obtain the following lemma easily. 


Lemma 2. There exists a probability space (Q, F, P) on which can be defined 
a minimal Q process X° = {x°(t), 0 < t < 6°}, a family of approximating minimal 
Q processes X? = {x"(a,t), 0 < t < ”(a)}, acA n 2 1, and a family of A,-valued 
random variables f"(a), ac A,, n2 oO, such that 


(i) P(X°(0)eE) = 1; 

(ii) for each a, the characteristic entrance family of all X” {n > 1)is (4{a, à), A> 0); 
(iii) P(f"(a)eY) = Gla, F); 
{iv) all X*, X? (ae A,,n > 1), f"(a) (ae A,,n > 0) are independent. 


When o? >0 and X (0 —0)=aeA,, we let o' =a'(f(a)), and Xi(t)= 
X*( f(a), t) for t <a}; otherwise let o! = 0. Obviously, X'= (x! (t),0<t<a'} 
is an Approximating minimal Q process. When a’ > 0 ong Xifcl 一 0)= EAs, 
we let o? = g?(f'(a)) and X?{t)= X7(f (a), t) for t < oa?: otherwise let g? =, 
Continuing with the procedure, we can obtain a tunma Q process X° and a 
sequence of approximating minimal Q processes X" = {X"(t), 0 < t <o6"} (n> 1). 
Define X = {X (t), 0 <t <a} according to (16.5)-(16.6). 


Theorem 3. X is a homogeneous Markov process with transition probability 
matrix P(t} = (p,,(t}) given by (11), the resolvent matrix (4) = (w;,(4)) of which 
is given by 


vis) = dsr | | ， (da, a yy "(a, db, A Jea (12) 
Ae Ae 
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where 
] T 
v°(a,T, a) = . noe 
1 ifaeT 
V'(a,T, A) = | G(a, dh)F(b, T, A) (43) 
Ac 


V"* tia T, =| V"(a, db, AV'(b, T, 4) 
Ac 


Proof. We can prove the first conclusion by following the proof of Theorem 5.2. 
Here we only point out how to calculate p;,(t) and how to apply Lemma 2. 
Clearly 


p(X (t) =f) = P({X°(t) =j, t < 0°) + L R 9 


where the first term equals f;;(t) while 


Rẹ "=P Ax ‘nie | Tt)=j, t+! <t<r+2) 
= | | | P(t eds, X"(o" — Ojeda, f"(a)edb, X"+ 1(b, t—s) 
0 Ae e 


=j,t—s<o"'!) 


Apply Lemma 2 and the above becomes 


mo=| | | G(a, db}H ,(b, t — s)L?* ` (da, ds) 
Ow Ae e 
where 


Lr, t) = Ptt! <t, Xo" — 0er) (14) 
Hence 


L! (F, t) = L(I, 2) 
t 
iro | | | Pi(rweds, X"- i(o"-!— Ojeda, f"- (a)edb, 
Ov Ae d Ae 


X"(b,0"(b) — O)eT, o"(b) <t — s) 


Applying Lemma 2 again we obtain (9). Therefore P,{ X(t)=j} equals p; jt), 
which is determined by (11). 

We now perform the calculation for the Laplace transform y,;(2). Take 
Laplace transforms on both sides of (11) to obtain 


wil y= ;;(A) 十 f 


Ae 


| G(a,db)n (b, à) > tl(da, å) (15) 


n=0 


$ 
3 
| 
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where 
rT, = | ATE rd (16) 
0 
Taking Laplace transforms on both sides of (9) we obtain 
het t(r, a) -| | G(a, db) F (b, F, Ajhi(da, 2) (17) 
ev Ae 
It follows from this that 
AOL A= | V"(a, F, Ah (da, A) (18) 
Ae 


In fact, the above holds for n = 0 obviously. Suppose it holds for n =m — 1. 
Then 


| V™(a, T, A)hAda, A) = | 
Ae 


Ae 


= | (| V™ l(a, db, Ah{da, i) V(b, T, a) 
Ae \ dde 


z | h”(db, DV1(b, F, 4) 
Ae 


(| V™~ ia, db, A)V1(b,T, aia 2) 
Ae 


(by the hypothesis of induction) 
= | | h™(db, 2)G(b, dc) F(c, T, A) 
Ae e 


= hee (T, A) (by (17)) 
i.e. (18) holds for n = m. 
Substituting (18) into (15) we obtain (12). The proof is completed. QED 


Remark ! 


We call X in Theorem 3 a generalized (DV)-type extension process of X°. The 
generalized (DV)-type extension may change the Q matrix because oo is not 
necessarily the first leaping point of X according to the fact that the probability 


P(X(0°)e Ejo? < œ, X(o° — 0) =a) (19) 


may be positive for some aeH. 


Remark 2 
Suppose that the Riesz decomposition of y{a, A) is 
n(a, A) = aa) (A) +.4(a, A) . (20) 
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Then, the generalized (DV)-type extension preserves the Q matrix Q if and only 
if the probability in Remark 1 is equal to zero, i.e. 


| G(a,db)¥ a,(b) = 0 acH, (21) 
Ae i 
or equivalently, 


G(a, db)a(b) = 0 acH, (22) 
Ae 
The generalized (DV)-type extension satisfying the above conditions is called a 
generalized (DV)*-type extension. Obviously, when Q is conservative, genera- 
lized (DV)-type and generalized (DV)*-type extensions are identical. For the 
generalized (DV)*-type extension ag? is the first leaping point of X and, 
furthermore, 


| G(X {0° — 0), db)a;(b) ifieE 

P(X (6°) = ilo? < œ, X(o° —0)) =! “^ 

| | G(X (o° — 0), db}M{b) if i= oo 
Ae 


23 
where oo 


M(b) = lim 47b, 4) | 


Ao 


Remark 3 


Suppose a(b)=0 for be A,. Then (22) holds. Thus the generalized (DV)-type 
extensions and generalized (DV)*-type extensions are identical; hence the Q 
matrix remains unchanged. Therefore, when a(a)=0, aeA., we call the 
generalized (DV)*-type a generalized V*-type extension. As pointed out in 
Remark 3 after Theorem 16.2, we only use the phrase ‘generalized V*-type 
extension’. For the generalized V*-type extension g? is the first leaping point 
and (22) becomes 


| 0 if ieE 
P(X(a°) = ila? < œ, X(o" — 0)) = | | G(X {0° — 0), db)M(b) if i= oo 
| (24) 
where 
M(a)= lim Alln(a, A)|| 
A+ æ 
Remark 4 


Suppose (å) is a Q process in Theorem 8.5.1 (remark: H in this section is 
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denoted by H, in Chapter 8). For ae A.. let 


H(A) if ae some a;eJ 


a, į) = 25) 
A f if ae some ajed — J (a 
and 
E if ae some a,eJ and be some ae J 26) 
otherwise 


Then G(-,-) and n(-,-) satisfy the requirement presented at the beginning of this 
section. For these G(:,-) and n(-,-), w(A} determined by (12) and that by 
Theorem 8.5.1 are the same. Therefore, for both G({-,-} and n(-,-) given 
by (25)-(26), Lemma 2 and Theorem 3 give the paths of Q processes in 
Theorem 8.5.1. 


PART V CONSTRUCTION THEORY OF 
BIRTH-DEATH PROCESSES: 
PROBABILITY METHOD 


Oe ee eee ee 


CHAPTER 12 


Probability Structure of 
Birth—Death Processes 


12.1 INTRODUCTION 


When E = {0,1,2,...}, and Q has the form (6.1.1), the process X 6 #’,(Q) is called 
a birth-death process. In this chapter, Q as used below will always refer to a 
birth—death matrix. In Chapter 6 we have constructed all birth—death processes 
by using the analytic method. 

In section 2.3, we have already pointed out that Professor Zi-kun Wang 
introduced the method for solving the construction problem for conservative 
birth—death processes in 1958, that is, the limit transition method. The advantage 
of this method is that the path structure of the processes constructed is quite 
clear and their probability meaning is obvious. In order to study the properties 
of the processes we may first make a clear study of simple processes and, then, 
it suffices to turn to the investigation of the limits. Therefore, this method has 
important potential value in terms, of theory and practice. For examples, see 
Xiang-qun Yang (1965b, 1966b) and Zhen-ting Hou (1975). 

The jogical foundation of this method is published in Zi-kun Wang (1965a). 
In the paper all honest birth-death processes are constructed. But in 
construction of paths, transformation g, and transformation f, are employed 
respectively to handle such cases as $< oo and S= œ. Zi-kun Wang (1980) 
provides a unified treatment for the two cases with respect to the honest 
processes. Zi-kun Wang and Xiang-qun Yang (1978, 1979) consistently handle 
the two cases and the case that processes are allowed to be stopping processes. 
The content of this chapter is derived from these two papers. 


12.2 PROBABILITY EXPLANATION OF 
THE CHARACTERISTIC NUMBERS 


We shall adopt the characteristic numbers and notations in section 6.2. In this 
section, we may assume ay > 0. Let X = {x(t),t <o}e#,(Q), t be the first leaping 
point and rw be the nth leaping point. Obviously 


x(t —0)=0 or oo (1) 
333 
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and we have |x 
(t, < T). 


(Ta) — x(t, — O)| = 1 for the imbedded chain Xy = {x(z,),t, < T} 


Theorem 1 


dolz —27) _ 
X! = P;{x(t—-0)=0} = q 2 
i EXE ) } = a(z —z0)+1 (2) 
Xi?=P{x(t—0)= 0) = i (3) 
olZ 一 Zo 


We introduce the convention w/o = 1 and 0-0 =0. 
Proof. By Theorem 7.8.2, X’ satisfies equation (6.2.19) where fọ = — ao and 
J, =9 (i> 0). Therefore by Lemma 6.2.5, we have 

Xj = [ao(z; — 29) + 1]. XG — ao(z; — Zo) (4) 


Similarly, X? satisfies equation (6.2.19) where f; >O (i> 0). Hence by Lemma 
6.2.5, we have 


X? = [ao(z; — zo) + 11X2 (5) 


Noticing X' + X? = 1, it follows from the above expression that if X2 =0 then 
X? =0, thus X' = 1; if X? > 0, then X? > 0, and consequently by the Martingale 
convergence theorem, we have 


X2 = P{x(t—0)= EE 1 


on the positive probability set {x(t —0)= oc}. Therefore, X? 41 (i> œ), so 
that X! +0 (i oo). Hence by (4) and (5), it follows that 


0 = [ao(z — Zo} + HX, — alz — zo) 1 =[ao{z — Zo) + 1] X2 


Hence when aoz < œ, 


00} x(To), x(t), 


x! = aoz — Zo) 2 1 


ao(z — zo) + | " aolz 一 zo)+1 
Substituting the above formula into (4) and (5), we obtain that (2) and (3) hold 
for aoz < co. By convention oo/oo = 1, (2} and (3) likewise hold for aoz = oo 
and the proof is completed. QED 


Set 
z- eae =i,t<t} 


© if the set above is empty 
Obviously, 
P, čati snt o)|x(t -—0)= co} =1 (7) 


(6) 
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Theorem 2. Fori<k <n, 


Zn fk “ET Ži 
Beate aeaee (8) 
Zn Zi n “i 


Proof. By Theorem 7.8.2, u, = P, {[ č; < ¢,} satisfies equation (5.4.11) where f; = 
1, f= 0 (i < k <n). By Theorem 6.2.3 and (5.4.12) we obtain the first expression 
in (8). The second expression follows from P, {č, < či} + P {či < č} =1 


QED 
Theorem 3. For i<k, 
P {č <t} oa Pile, <t} = e (9) 
P,{t < č, x(t —0)= 0} = a (10) 
Proof. Since on {x(0) = k}, 
GT Ü (< 
E< A ba<td={t<E,,x1t—0)= 0} (11) 


Taking the limit in (8), we obtain (10) and the first formula in (9). Secondly, 
since u; = P(E, < 1) (0 < i < k) satisfies equation (6.2.13) for n =k, f;=0 (i < k), 
and f} = 1, the second formula in (9) follows from Lemma 6.2.4. QED 


Theorem 4. Ifi <k <n, then 


Za — 2% aa Zr 2; 
Ex {é,6:<¢,$=7-—— YO (2 Zu 
Za 2 j=i+1 fy ži 


ek Ke l 
Pied Mae, > J — 2 (12) 


Zn Zi j= Zn Zi 


二 k-l > 一 之 . 
有 人 < 人 一生 DT i zy 


Zn 一 Zi7=i+l2nr 一 2 


到 一 Zi Ze Zi 
-一 一 e 2) Hj (13) 
Zn — Zi jak Sn Zi 


Proof. By Theorem 7.8.2 and Theorem 2, u, = E,{€;,¢;<€,} satisfies the 
equation (5.4.11) for fi = f, =9, fk = (Zn — 2,)/(Z, — 2;) (i< k <n). By Theorem 
6.2.3 and (5.4.12) we obtain {12), and (13) can be derived similarly. QED 
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Theorem 5 


a2 
E,{t, x(t —0) = co} = i 


[ao(z — Zo) + 1]? 
Z— žk to aolzj ae, 


T ae =z) 1 


do(zk — Zo) +! & ao(zj— —Zy)4+1 
Ok 0 of ES | om z); (14) 
ao(z — zo) + 1 j=k Ao(Z — Zo} + 1 


Proof. Let u, = Er{én X(t—0)= co} (k<n). Then u, satisfies the equation 


(6.2.13) for f, = Py {x(t — 0) = œ} (k < n), and f, =0. By Lemma 6.2.4, 


E, {n x(t — 0) = œ} 2 ray i 


Zn — Zk o aoz; — Zo) + 1 


Ao(2, a ae a i ao(z—2z0)+1 


$ AolZk — Zo) + 1 "©! ao(Z; — Zo) +! 
aofZa — Zo) + 1 jk ao(Z— 2o) + 1 


Noticing (7) and taking the limit in the above expression, we obtain (14). The 
proof is terminated. QED 


(Zza =z); (15) 


Theorem 6. Let ao =0. 
(i) Let c,; be the probability of going from k to j in finitely many wz 0) steps; 
then 
| 1 ifk <j 
(z — z,)/(z — 2;), ifk>j 
(ii) For the minimal Q process X to be recurrent it is necessary and sufficient 
that z = æ. If z = oo, then for it to be ergodic it is necessary and sufficient that 
ie oti < 0. 
(ii) m; N; and R and determined by (6.2.4)-(6.2.7), so that 
m; = Eiis Ai 一 三 iT R= Eor (17) 


(iv) The necessary and sufficient condition for P, {t < œ} = 1(keE)is R < œ. 


c= P {<t} = (16) 


Proof. (i) follows from (9). 
(ii) The probability starting from 0 and coming back in finitely many steps is 


bo 
So = 一 Pi(Ey<t)=- 


ao + bo Z— Zo 
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From this we know that f¥ = 1, that is, for the minimal process to be recurrent 
it is necessary and sufficient that z = co. 

(ili) When ao=0, choosing k=n—1 in (15) we obtain E,_,é,=m,_,. 
Equation (14) a, = 0 is just the second and third formulae in (17). 

(iv) By (17) and N, < R we know that if R < œ then P,{t< oc} = 1 (keE). 
Conversely, if P {t < œ} =1 for some (hence all) k then by Theorem 7.8.2, 
u,(4) = E,(e" **} #0 (A > 0) satisfies D,u* (4) = Au(A), and so by Lemma 6.2.5 

i-1 
uli) = uolå) + 4 之 (2;—2,)ufAu; 
j= 
Moreover, obviously, u;(4}1, (if), and therefore 1 > u,(A) > Aug(A) 42 yz zH 
1 > Aug(4)R, and hence R < cœ. The proof is completed. QED 


Theorem 7. Let ao = 0, S = œ (see (6.2.7)). Suppose that X = {x(1),t <o}ex dQ) 
and that € is determined by (6). Then for A> 0, E,{e~**°} | 0 (it oo). 


Proof. Since X must visit i—1 while going from i to 0, therefore, 
u{A) = E,fe~**} |a >0 (if ©). By Theorem 7.8.2, we obtain uo(A)=1, Dus 
(A) = AufA) {i > 0), that is, 


b. 
Ui (A) — ufA) = Luda) — uis sfA)] +” uà) i>0 


Applying the above formula again, we have 
bb 


+j+1 
A [ui 54 (A) 一 Ui+j+ 2(A)] 
CCi+1 Git ji 


u; (2) — uf4) = 


Dig Mises 2) 


1 
Qe t=O 0iQ+1 Mitiditi+! 


l bib; 
>i" y — i+ bist Xx 
a; t=O GGz4 Aiti 


Letting j > œ we obtain u,_ (A) — u{A) > Ae;x (i > 0), so that 


i 
] > ugli) > uo(A) — uf) > a( Ye )s 
k=1 
Letting j— œ we obtain 1 > ASa. Since $ = œ, it follows that « = 0. The proof 
is over. QED 


Theorem 8. If ag =0, S = œ, then P{E,, <0} =0, where č is determined by 
(10.4.1). In other words, each Q process X€3%,(Q) is pure entrance from E, or 
we may say X cannot be entrance from ‘oo’. 
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Proof. First we prove P{é, 9 <a} =0. We shall use reduction to absurdity. Put 
Q;=(¢,.;< 0), and suppose P(Q) > 0. Obviously, Et (iT). We write QT 
(if oc). By Lemma 10.4.3 and the strong Markov property, we may consider the 
process X;= {X (čni +t), t <a — či on the probability space (Q,,0,F, P(-|Q,)). 
X; and X have the same transition probability matrix, and P{x{0) = i|Q,} = 
We denote by čj the random variable defined by (6) for X,. Since 

uf) = Ejexp(— AŠ (18) 
is determined only by the initial} distribution and transition probability, 
thercfore, the quantity given by (18) and the quantity in theorem 7 are equal, 
so that uA) L0 (iT oo). 

On the other hand, 


! i 
u{A) = —— | exp(— Ag, )dP 2 -= | exp(— Agé,)dP 
PO) Ja PQ) Jeg nF 
Since či <€,;< oo on Qo, it follows that 
uA) 2, a -| exp(—4é,o.)dP>0 
j Jas ° 
This contradicts ui(2)|0. Therefore P(E „o <o)=0. For i> 0, 
J a 
P{E x0 <0} 2 hE <o} TI 一 一 
k=1 a, + b; 
Consequently, Pl(é.; < o) = 0. The proof is completed. QED 


123 AN EXTENDED DYNKIN LEMMA 


We shall prove the following extended Dynkin lemma, where the processes may 
not necessarily be birth-death processes. 


Lemma I. Let X = {x{t), t < ote X, č be a non-negative random variable and @ 
be a translation operator satisfying the following conditions: 


(i) For arbitrary s > Qand t > 0, the set A, = {¢ > s}e F? and A ,, S A, nb4，. 


(ii) There exist positive numbers T > 0 and « > 0 such that for all i€ E we have 
P{A r) < 1 一 &. 


Then for any initial distribution, all moments Eë’ of & are finite, and the 
distribution function P{¢ <t} is uniquely determined by its moments Eé' 
(i = 0,1, 2,...). 

Proof. Since A,c.F°,0,A7EF*,, by the Markov property, we obtain 
PAT} < PAA, NGA rhe | Pa(47)dP 
As 


< (1 — a)P{A,) 
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Therefore P{A,7)<(1—«a)". From this, we get P(A,;)<(1—%)” and 
P(E < 00) = 1. Thus, 


us 


E[N = > | HAP < >》 {n+ DTYP{č> nT} 
nT<č<(n+1})T n=0 


< VY fn DT} — a)" < 0 


n=0 


Next take a positive number r such that e™%(1 — a) < 1, then 


x FF l ©% © DT Vr lyt 
> E{¢} r< > > (iat ) ora — a)" 
o «(C&S 1=0 n=0 i! 
xc Tr 
Z in+ Try g = -—_-- < 
ee) 


By a theorem in Cramer (1946, section 15.4), the distribution function of č is 
uniquely determined by its moments. The proof is concluded. QED 


12.4 RECURRENCE AND ERGODIC PROPERTY OF THE 
HONEST PROCESS 


From now on, we shall always consider conservative birth--death processes, that 
is, ao = 0. By Theorem 2.6, the minimal process is honest if and only if R < œ, 
hence we further suppose R < œ. Then P{t< œ} = 1. 


Theorem 1. Let X = {x(t),t<o}e#(Q) be honest, and t be the first leaping 
point. Put 

BY =inf {tlt <t <o,x(t)<n} (1) 
Then for any initial distribution, all moments E[B’ ]' (! > 0) of $} are finite, and 


its distribution P{f" < t} is uniquely determined by its moments EĻ £3]! (/ 2 0). 


Proof. Since P{t < œ)=1 and X is honest, it follows that there exists s >Q 
such that 


0 < Polt <s) = Poft <s,x{s)eE} = > Poft <s,x(s}=j} 


So there exists je E such that Po{t < s, x(s} = j}>0, we have 
a= Poi B? <s +t} > Poft <s,x(s +t) =0} > Polt <s, xis) = f}pjolt) > 0 


However, on the set {x(0)=i, p] <s +t}, for n* defined by (6.7.7), we have 
ne, < co and fp? = n%, , + Oe Bi Therefore 


{x0 =i p? Ss +t} E (xO) =in < 0,0 (P<s+0))} 
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Hence Pi f><s+t} increases with i If we choose T=s+t, then 
Pf BS <T)22>0 (ieE). Thus the condition (ii) in Lemma 3.1 is satisfied; 
obviously, the condition (1) in Lemma 3.1 is satisfied. By Lemma 3.1, this theorem 
holds for n = 0. Again noting £" < 89, we obtain the proof of the theorem. The 


proof is terminated. QED . 


Theorem 2. All honest processes Xe (Q) are recurrent and ergodic. 

Furthermore, all order moments E[y*]' of 4* defined by (7.7.7) are finite, and 

the distribution function P(n* < t) is uniquely determined by its moments E[y*]' 

(l > 0). 

Proof. Since n¥ < f° (n > i), quoting Theorem 1, we can prove this theorem. 
QED 


125 TWO LEMMAS 


Let X = {x(t),t<o}e#(Q). If X is stopping, we may take A= -- 1, and 
transform X into the honest process X= 
as (7.6.6.), where Q = (4,,) (i, je(— 1) E), and ĝi = gy ĝi =4-1,-1 = 4- 1g =9 
(i, jEeE). Henceforth we shail adopt the convention above. 

Let t still be the first leaping point, and t, be the nth jumping point, and č; 
be defined by (2.6). For arbitrary 0 < £ < 00, put 


x fOcgx<e 
s=] ; (1) 
2 ifx>e 
Lemma I. For k >i>0, put 
Hy; = d > fATi+1 — | (2) 
Ori< min(ž;.t) 


In particular, 


Hoe=E{min(tst)} -> (3) 
Then when R < œ, we have 
Pa Soa a 
Hi=-— $, (@—z){1—exp[—(a;+ belje; 
Z— 2; j=i+1 
Zu Zi = 
rere (z —z;){1 —exp[— (a, + bel} uj; < N, (4) 
— 2; 55k 
and 
lim Hi, =0 (5) 
Page) 


{X(t),t < of EH, (O), in the same way’ 


cnr at r 
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If we also have s < co, then 


H;i I x1 
lim --# =. 2 (z;—2z){1 —exp[—(a, + be]} (6) 


k> Ca Cio j=i+1 


lim lim Hi =0 (7) 


i>n koro VKO 


PER EE L T, (8) 


ELO k> œ Vko 


where C,; is determined by (2.16). 


Proof. Leti<k<n. Put 


Hi = Ea} X fue- (9) 
OSri<mintsi,én) 
Obviously, Hj, 1 Hý; (nT 00). We see easily that 


1 
Erf AT) = PET —exp[—(a, + b,e]} 
k tD 


iim Satisfies equation 
(5.4.11) for f; = fa = Q, fa = 1—exp[— (a, + be] (i < k <n). From Theorem 6.2.3, 
we obtain 


By an application of Theorem 7.8.2 it follows that u, = Hj 


7 — k 
Hi = OY (z—z) {1 —exp[— (a; + bel fu; 


Ze 2; %S! 
x (z, — 27){1 —exp[—(a;+ belyn; (10) 


Zn 2; j=k 


Letting n— œ, we obtain the equality in (4). In comparison with (6.2.6), the 
inequality in (4) follows. 

Since R < œ, by using the dominated convergence theorem, (5} follows from 
(4). 


When s < œ, we have 3° oH; < 00, whereas 


1 —z, & a 
-TE S (zz) {1 ~exp[—(a, + beju <z ¥ 0 (k= 00) 
Cro Z — Zi j=k j=k 
1 oo a . 
2 (g—z){t —exp[-(a;t+bje}}uj<z ¥ p20 (i— oo) 


Cio j=i+ 1 j= 这 1 


Therefore, (6) foilows from (4) and, thus, we obtain (7). Using the dominated 
convergence theorem, we derive (8) from (6). The proof is completed. QED 
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Lemma 2. Let X€#{Q) be a non-minimal Q-process, t be the first leaping 
point, and f be determined by (4.1). Then 


P| lim pasha (11) 


n> or: 


Proof. Obviously, Pil(n1), hence lim,.,, 8" >t. On the other hand, for 
arbitrary positive ¢,, | 0, by (ii) in Theorem 7.6.2, it follows that P{x(t + ¢,,)= 00} =0. 
If t =o, then, certainly, lim, Bj = t. If t <o then when m is sufficiently large, 
we have t+é,,<o and x(t +¢,,)e£. Therefore when n>x(t+6,,), we have 
Bi <t+é,, and limpo pI STE Since m is arbitrary, it follows that 
lim,- Bj <t. The proof is concluded. QED 


12.6 CHARACTERISTIC SEQUENCE 


Let X = {x(t),t<o}e#(Q) be a non-minimal process. We consider the 
transformation g in Definition 10.5.1. Let 8% =0, t? be the first leaping point 
for X, and 


Bi=inf{tr <t<o,x(t)<n} (1) 


If the above set is empty, we take ø as ‘inf’. Suppose that t”, _,, 
defined. If 8r- =, then we define 1”, = bf" = 0; otherwise, we define t”, as the 
first leaping point after B" _,, and 


pr = inf {tjt <t<a,x(t)<n}. (2) 
Transformation W.,, p becomes transformation g, and X” = Wn p(X) becomes 
X" = gn(X) (3) 
We have 
gX" +=X" (4) 


In particular, if X is a (Q, z) Doob process and z; =0 {j >n), then g,(X)} = X 


Theorem 1. Let Xe X (Q) be a non-minimal process. Then X” = {x"(1),t < o”}e 
X (Q} given by (3) is a (Q, V"} Doob process, ‘satisfying (4), where 
y” = (vj,0 <j <n), with 


vt = Pix Bt) = j} (—1l<j<n) (5) 


satisfies 


= jagal, 3 orth 十 


一 1 

at i 

; ee —l<j<n 
i== 


pr, are already 
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=ý 
R {nti n+i atl n+1 
Va = (Up + Cas a) ( s vy Hott} 


i=~-1 


> v7 >0 (6) 


j=-1 i=0 


For X to be honest it is necessary and sufficient that v” | =0 (n > 0). 


Proof. Noticing that Bf is a Markov time and P{x(8}) > n} = 0, we now proceed 
to prove that V” defined by (5) satisfies (6). 

Let the quantity Fi be determined by the process X = {x(B1*' + 0), 
t<o—"*'}, in fashion (1). Suppose that A, is the event that the process X 
goes from n+ 1 to n in finite (> 0) steps, and A, is the complementary event 
of A,. We can easily identify {x(B"*!)=n+ 1}, A,, A, all belong to F ai} and 
fB =j EF nth By the corollary to Theorem 7.17.1 ‘(note that the conditional 
independence i in this corollary becomes independence in the case of birth-death 
processes), for —1 <j <n, 


A = P{x(Bi**)=n + E An x(B1) = 7} 
= Pix(BU =n + LA} PUB) = jix ant 1 
= Pix(Bi* yan + 1}P{A, x81 =n Lor 
= 41 — Coa lO) 
Consequently, 


va = PUX(BL an} + Pip y= nt LAA} + Ag 
= op F Ue ewe x: ae eit! gi Cari nUn 


= PIB =j} +A E y R Cresa (1 <<a) 


pia 
oh = vr — ot — Cpa iad) —i<j<n 
op = (0 tO Cae nl — OFF Cl — Cr1,n)] 


From the above expression, we know that either P{ $7 <a} > 0, for all n, or 
P{ fp" =o}=0 for all n. If the latter holds, then by Lemma 5.2 we have 
P{t =o} =1, that is, X is a minimal process, which is contradictory to the 
hypothesis of this theorem. Hence 


(7) 


> vt = P{p" <a} >0 (n > 0) 


Next we shall prove >- _, v; = 1. From this and (7) follows (6). When X is 
tones, by Theorem 4.1, we have P{f" < œ}=1. Therefore v” ,=0, and 
“=007=1. When X is stopping, we taking zo=1, z;=0 (j>0). By 
Theorem 11.2.2, we may take into account the 2D-type extension process 
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X ={X(,1< æ} of X, that is, 
X(t) = x(t) t< 


P{x(o)=0lo<w}=1 (8) 


Letting J'i be the quantity for X, obviously, 6" =f". Since X is honest, and 
PB < co) = 1, it follows that $7. _ v; = Pi Bi < o}=1. 


Suppose v" ,=0, that is, P{p{<o}= }, v}=1. By the strong Markov 
j=0 
property, we have P{ Bi < p3 < <o} = 1. This shows that there exist infinitely 
many j=j(m) (<x) intervals in [0,o(w)). By Theorem 7.7.1, we have 
P{o = co} = 1, that is, X is honest. 

We now prove that X"=g(X) is a (Q,V") Doob process. Set 
X m= (X(BR + < — Bt} (m > 0). We can easily see that X „eX (Q) is a 
minimal Q process, satisfying (ii*) in Lemma 11.3.1. By R < œ, Le. P(t < oo) = 1， 
we know that Bf. <c if and only if 0 <t”, — 83 <œ. By the corollary to 
Theorem 7.17.1, we have 


P{x™*1(0) = jO < th, ~ Br, < 00} = PLB 1) = JBI, <0} = 


Therefore (i1i*) in Lemma 11.3.1 is satisfied, too. By the strong Markov property 
of X, we may directly deduce that (iv*} in Lemma 11.3.1 is satisfied for 
A = {x™*1(0) = i}. It is not difficult to verify that X „(m < k) is Fn -measurable, 
and X,, (m>k) is #'» -measurable. We have already pointed out 
{O<t,, — Bt <0} =(B"<<). By the corollary to Theorem 7.17.1, (iv*) in 


O<j<n 


Lemma 11.3.1 is satisfied. According to Theorem 11.4.2, the process determined . 


by (11.2.5) and (11.2.6) for X,, (m > 0) is a (Q, V") Doob process. But this process 
is precisely X" = g,{X). The proof is completed. QED 
Theorem 2. For any X = {x(t),t< c}e#{Q), we have 
Pfo<œ}=0o0or l1 
Proof. Fhe conclusion of this theorem is valid for each minimal process or 
honest process X. Assume x is stopping and non-minimal. 
By Theorem 1, we have 

P{pi=o=aofs=1-— } w=0 
that is, | 

P{f" <o= œ} + P{o < oo0}=1. (9) 
By the strong Markov property, we have 


PIB <a=a}= Y "P {o= o0}. 


j=0 
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But u; = Pj{o = œ} satisfies the equation Qu = 0, so that u; is a constant; that 
is, P(g = œ) = P(o = œ) is independent of j. Therefore, (9) becomes 


( 也 st) Plo = 0} + Plo<a}=1 


j=0 

By Theorem!, we have 0< 3% _guj<l. Therefore, P{o=co}=0 or 
P{o < œ} =1 must follow from the above formula. The proof is concluded. 

QED 


Theorem 3. Let X = {x(t),t <o}¢#{Q) be a non-minimal Q process. Then there 
exists a non-negative sequence of numbers p, q and r, (n > — 1) satisfying 


p+q=l 
ra= 0{n 20) ifp=0 (10) 
0< F rN, <0 ifp>0 
n=0 
such that 
vt = P{x(B1) = j} —~l<j<n (11) 
which may be expressed as 
vr = (X,/A,)r; —1l<j<n (12) 
v= Y, + (X,/A,) pa riCim 
where 
ee i= ae coe 
{=0 Í ifp=0 
= A,Cyo 
"(ry tA)Cno +d 
d 
LS (13) 
(r_, +A,)Cro +d 
X C 
二 if p=0 
A, r_iCno+!1 
If we let 7 be the last leaping point before 8°, then 
r_,/(r_, + Ag+) ifj= —t 
P{x(n) =j} =< rjCjo/(r_-, + Ao td) fO0<j<a (14) 


djr., + Ag+) ifj = 00 
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Above, p and q are uniquely determined by X. If p> 0, then y, (n> — 1) is 
uniquely determined by X except for a constant factor. If p = 0, then y, (n> — 1) 
is uniquely determined by X 


Proof. The proof is to be established in several steps. 


(a) Put 
三 T Crp S, = onCio A,=R, +S, (15) 
Then by (6), we fae 
o<A =t og tn Crot Sasi (16) 
On+1 Ons) 
a= opt In+1Cn+ im (17) 


Therefore, vi/A, is independent of n >j (j> —1), and there exist limits 


S R 

lp>0 —"tq20 18 

a? 和 13 (18) 
If p=0, we take r= 1; if p>, we arbitrarily take y > 0. Put 

r=} >jz-—1 19 

m n>j (19) 


Thus we obtain the non-negative sequence of numbers p,q and r, (n> — 1). 


(b) Obviously, p +q = 1. Since when p= 0, we have r, =0 (n > 0). If p>0, 


then there exists a r, > 0 (k > 0) at least. Therefore, we need only prove 
co 


yyy < oo | (20) 


下 三 站 


Note that EB? < œ. When X is honest, (20) follows from Theorem 4.1. When 
X is stopping, there exists an honest Q process X satisfying (8). Hence we also 


have Ef? = EB? < œ. Whence 
Et) = Ep) + E{t — Bo} = EB? + v8Eot = Ep? + wR < oo 
Put 


: otherwise 


M" = i i+ l — BF if B? < BY 
0 


Obviously, 


oo > Er? > È EM = VY Ef" Tat ,p< pO} 


i=l 
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But 
Ett — BiB <B = YE sth = eN; 
j= j= 
Efri poB <p = 2 P{BI_, < BY, x= jEr 
j=1 
n a i-1 
= | X mc) oN; 
j=1 (k=1 
Therefore, 
ee vo" N. ee oN, 
Eee. er 


1—9- nl E) o, +A, 
By (19) it follows that 


Det! irjN; 
roi +r 


+4 < Ert? < 00 


Letting 1 一 oo, we obtain (20). 
(c) We now proceed to prove {12). By (18) and (19) we have 


R,, [wet Ag 
p=lim-"=lim- 》mCo= 一 
r 


noo Gp n>% l j= 0 


so that 
l ifp=0 
Using induction on (6) we easily obtain that: m >n, 
vi =V imn —l<j<n 
+(e) 
= (22) 


0<A,=A,,/Omn 


= Yom Ý 


了 二 j=n+1 


From the above, (18) and (19), we have 


v” DFC jm _!I" 1 S m 
a. jen j Dj jm rj C, A 十 一 
A, An ee i A。 rom 
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so that when m-— oc, we have 


ft l x i 
was X r Cin + A. (23) 


R -1 ie 4) 
l= > p= a (Mea 十 ZaiCm 十 T, ) 
r 


r Co 
hence, 
= rCno 
j (r-i + An)Cro + qr 

Substituting the above formula into (19) and (23} and noticing {21), we have (12). 

(d) We now prove (14). If X is honest, then 1 = P{ 8" < œ}. By the strong 
Markov property, we have P(B" < p3 < ---)= 1; therefore, for almost all weQ, 
there exist infinitely many j{w)( < n) intervals in [0,lim,_, , B7(@)) for X, whence 
P(lim,.,,.8; = 00)=0. If X is stopping, by Theorem 2, we have P(o < oo) = |. 
Since if 8 (0) < o{a), then P?(w) < t7, ,(@) < BP, (œ), by Theorem 7.7.1, we have 
P {there exists | such that 87 =o} = t. Thus we always have 


pf lim py = | 一 | (24) 
i> a 


whether X is stopping or honest. Moreover, for almost all œ, there exists unique 
l such that B7_, <n < B? < B°. Write las l, that is, 


l= min {1| 8; >n} (25) 
Bh = inf {t|y <t <o, x(t) <n} (26) 


If x(87) =j for some n >j > — 1, then it necessarily follows that 87 =. Since 
if n < Br by definition we have n < x(t) < œ for te(y, Bi), while x(B7)=j <n. 


As the jump of birth—death processes at the jump point is 1, this is not possible. . 


Hence for n>j>—1, 
LER =F} {BL = 0, xl) =F} < (x(n) = 3} (27) 
Again it is quite clear that, if x(q) = j, then for n >j we have br =n, so that 


(x(n) =j} = lim {x(B")=j} (-1<j<oo (28) 
We shail now prove 
{x(n = oo} = lim {x(B7,) = n} (29) 


no 


In fact, assuming that œ belongs to the right-hand side in (29), we surely find 
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Br ln2n. Hence by the right-continuity, we have x(q)=lim,., x(P1)= 
lim, ,n= 20. But by the definition of y it follows that for any y < t < B9, x(t)eE. 
Hence 4 = n, whence x(4) = œ, Le. w belongs to the left-hand side in (29). Letting 
w belong to the left-hand side in (29) for arbitrary n, we certainly have xpi) =n. 
Otherwise, (27) will yield x(m) =j 4 œ. Thus (29) holds. 


For 0 <j <n, we have 


PP =i} = È Pll) = 一 


ee Pt -1 < PXD =A BT < BY < Tha) 


ec, 


-> > vn — Col Cn = 0 
and 
P(x(Bi,)=—1} = È P(X) = 1h 
= PUB. <pY,x(BD)= 一 
© n i-1 u” 
=> 人 vill — co mest BN 


Substituting (30) and (31) into (28) and (29) and, moreover, noticing (18) and 
(19), we obtain 


r-r- tr) ifj= —1 
P{x(q) =j} =) rjCjof/(r-1 +r) f0<j<o 
rq/(r_,+yr) ifr = oo 


Again noticing (21), we find that the above expression is (14). 

(e) Suppose S=a. By Theorem 2.8, we have P{é&,.<o}=0. But 
{x(n} = 00} {two <0}. Hence P{x(y} = œ} = 0. Then q =0 follows from (13) 
and (14). 

(f) Suppose that there exists a non-negative sequence of numbers p,g and 
F (n > — 1) such that (10)-(14) hold. By (12) we know the following: Either both 
p and p are zero; hence F, =r, =0(n > 0) and q = gq = 1; and again from 


Cno Cro 一 
一 一 一 一 一 -1 三 一 -8 
r iCat! r_,C,ot+1 


n = 
vi = 


-1 


it follows that r_,=7_,. Or both p and 5 are positive, and (18) follows from 
(11) and (12), so that p=p and q=q; and again by (19) we have 
rj/r, =05/vy =7,/r,. The proof is completed. QED 
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Definition 1. The non-negative sequence of numbers p,q and r,(n > — 1)is called 
the characteristic sequence of the Q process X. 


12.7 PROBABILITY STRUCTURE OF PROCESSES 


Suppose that a sequence of numbers p, g andr, (n > — 1) satisfying (6.10) is given. 


Lemma I. vi(— 1 <j <n) defined by (6.12) and (6.13) satisfies (6.6). 


Proof. When p= 0 we have vi = 0(0<j <n), 
y" = "1Co noo l 
ad r_iCyo t1 r_iCnot+!1 


Equation (6.6) follows from direct identification. 


Let p > 0. By direct identification, we know that the last expression in (6.6) is 
valid. By (6.12) and (6.13) we have 


I~ vrtil—C ets) = È GHR Ca 
oe X, 2 
本 ae? Pt Es Core a T a > ri Cin 
n+1j=-1 . nj=atl 
2 a(r rp Teste) 
n+l n 
X, EN XTA 
roel ake ree ee (1) 
n+1 Cro An+i Xn 
a a Xa X = 
v n HOR Catia = a Tn +t+YrCrrint— E nC, 
n+l n+tf=nt+1 
Xavi A, n Z 
saya oar) nC) a 
Therefore, (6) holds. l QED > 


Lemma 2. Suppose that V” = {vj,0 <j < n}(n>0) satisfies (6.6). Then there 
exists a probability space (Q, F, P) on which we may define a sequence of (Q, V”) 
Doob processes X = {x"(t),t < o"}€H,(Q)(n > 0) satisfying (6.4). 


Proof. Fix a distribution (v;) as an initial distribution. For each n, there exists 
. Peron space (Qp Fn Pa) on which a (Q,V"} Doob process 
= {X,(t,@,),¢ < d,(~w,)}(@,€Q,) is defined. By Theorem 6.1, it follows that 


che inm ee a ee aa a $ 
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for m <n, Zm = G(X) is a (Q, V”) Doob process on (0,, F n P,). Let k > t. For 
non-negative integers n,{1<i<k) and non-negative real numbers t; 20 
(1 <i<kjand j,eE(t <i<k), we may choose n > max(ny,M2,...,%) and define 
the k-dimensional distribution 

Paf Zn lti On) = ji 1 <i<k} (3) 


It is obvious that this distribution is independent of the choice of n and, 


Fiat ag Ged = 


getty 


PERET 


consistent. According to the Kolmogorov theorem (see Zi-kun Wang, 1965a, 
section 1.1, Theorem 1), there exists a probability space (9, 7, P) on which a 
sequence of processes X” = {x"(t), t < a"} is defined and, moreover, 


P{x "(G )= =j,! sis k} = Foa sate marli» =< jk) (4) 


From the above and (3), X"e.#.(0) is a (Q, V") Doob process. 

Secondly, according to the theorem quoted above, we may choose Q = (w), 
where w = w(n,t) is a bivariate function taking values in E, (n = 0, 1,2,...,te 
[0, ¢,),0, < 00), and x(t, œ) = w(n, t),0"(w) = o,. Therefore, (6.4) holds. The proof 
is terminated. QED 


Let X” = {x"(t),t <o"} be the sequence of processes in Lemma 2. From (6.4) 
it follows that o < on"+1 Hence we may set o” fa. 

The quantities defined by the fashion in (6.1) and (6.2) for X * are written as 
rt and Br. From (6.4) it follows that 83° < B® <o"*!. Therefore, there 
exists the limit f° = lim, Bt? <a. 

On account of (7.2.4) lim, ,,B2 > lim, .. ,, B23? = g". Therefore 


pi lim p=o)=1 (5) 


For n > m, put 


mm nm : nm nO 
ie vee ee 6) 
0 otherwise 
and 
T= J, filth je. T) (7) 


stAT 


where ti, is the jth jump point after the ith leaping point of X". The process 
f{X) is defined as (5.1). By (6.4), we easily obtain 


i=1 (8) 
Tr < T 1.0 TO < T"? (e; < £2) 
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Consequently we may set 
Lam bm (at x) Lad L(mt x) 


TTT. (nt x) T, | T (€10) (9) 


Lemma 3. P{L=0} = P{T=0} =1. 


Proof. Put 
prm = inf {tit > th x(t) <m} 
We consider 
Ft ane Lop) =T ifto <89 and m<x"(t") 
0 otherwise 
and 


>. SATE js 1 Thy) >en nO 
TO) shy cstycmineh 1A) if tio < Bi 
0 otherwise 

By the definition of L,,, and T° we have 


= 有 
i=} 


But by Lemma 5.1, (6.11) and (6.12), we have 


=È È Pin < p(t) = Emine oB) tolx) = 


oo n n i-1 
Dy Ds f È Go} Tp pa 


i=1j=m+1 (k=1 
wm 

ie date m+ OV im 

ott =0%% Cro 


Pe diame ty a + (d/Cyo + DariCi) nT 1Cin) Him 
r_,+A td 


and 


few jr — TH) Xalto) = e} 


n a . n zno 
S Tj< min(fi 19h; } 


PROBABILITY STRUCTURE OF PROCESSES 353 
n n i~i 

-Ë È {ÈC} iH 
t=Lk=t = 
ee err tko 

vt 5205 Cjo 

Lena se Hko + (d/Cno + Lie aiCind po 

r.ytAgtd 

By (6.2.6) we may verify C,,N, < N,(/ 2 n). By Lemma 5.1, (6.10) and (6.12), 


it follows that Him < Nj, ZF ot;Nj < œ and lim, jo Hio = 0. If s = œ, then d = 0; 
if s< oo, then 


; . H” ee e i 
lim lim -7 = lim lim -2 =0 
mon pg £j now nO 


Therefore, by the above two expressions, we obtain 
EL = lim lim ElL,,, 


lm ,oY m H+ lim, . (d/Cro + TosnCmHe 


= My oe =0 
fvi 4 A +d 
and 
ET = lim lim ET”° 
EJO 一 个 
_ limo 2i- leo + limo lim, (d/Cno + LisaliCin Hino -0 
r_,+Agt+d 


On the basis of this we have proved this lemma, and the proof is completed. 
QED 


Theorem 4. For the sequence of (Q, V”) Doob processes X” = {x"(t),t<o"} in 
Lemma 2, its strong limit process X = {x(t)t<o} exists. Xex (Q) is a 
non-minimal process. X is the unique Q process satisfying (6.11), that is, X is 
the unique Q process having the characteristic sequence p,q and y,(n > — 1). 


Proof. (a) Obviously the limit o"(w)f o(w) exists. We now proceed to prove that 
for almost all weQ, and almost all te[0,¢(w)) in Lebesgue measure L, x"(t, w) 
is convergent to some state in E; for other te[0, a(w)), x"(t, œ) it is convergent 
to œ. 

Without loss of generality let us suppose that, for each weQ, X"(w) has only 
a finite number of i intervals (ie E,n > 0) in any finite interval [0, t)(t < o(@)). If 
every constant interval (i.e. general i interval) of each X” is translated towards 
the left and, furthermore, the distance covered by translation of every interval 
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is not greater than <, then the total length of the intervals composed of the 
points ¢ which are in the interval [0, £1°(w)) and make x,(t, ©) # x,,(f, @)(n >m) 
is not more than e+ Tw) < e+ T,(w). Fixing k, taking n>m>1(>k), on 
account of B"°(w) > 8% (œw) we obtain 


L{t|te[0, BY°(w)), x,(t, 0) £ X_(t, 0) 
< Lo) + Ty gel) (10) 


Set Qo = {L,+ T,, 10,17 oo}. From Lemma 3 it follows that P{Q)} = t. Given 
wENg, from (10) we know that x,(t,@) converges in [0, B*°(@)) in accordance 
with the Lebesgue measure L and hence there exists a subsequence mi 一 oo such 
that x,,(t,) converges for almost ali t in [0, 84° (w)). Fixing a convergence point 
to, since the Doob processes do not take the value ‘oo’, consequently there exists 
MEE such that x,,(tp,w) > M(i— œ). As E is discrete, there is a positive number 
N such that l 


mn (lo 0) = M (i> N) (11) 


Now we start to prove that there exists a positive number N’ such that, ifn > N’, 
X,(to, ©} = M; hence x, (to, w) converges to M. Otherwise, there must exist m; 一 oo 
such that 


Xmitto， w} #M (12) 


From this formula and (11) and by g,(X")= X™(m<n)} we know that in 
[0, to}, X" has infinitely many M intervals. And this contradicts the hypothesis 
at the beginning of the proof. 

Consequently, provided that weQp, then for almost all te[0, 84°(w)), x,(t, 9) 
is convergent to the states in E. Setting k — oo we find that the same conclusion 
is valid for [0, B°(@)). We can verify in the same way that the same conclusion 
is true for [0, BP(w)). From (5) we know that x"(t,) converges to the states in 
E for almost all te{0,o(@)). As for the exceptional re[0, o(w)), if x"(t,@) does 
not converge to oo, then there surely exist two subsequences n; and m; and 
MeE so that (11) and (12) hold, which will likewise lead to contradictions. 

(b) We are going to prove that P{x(t}= œ} =0(t >0). On account of (a), 
L{t|x(t,w) = oo} = 0. By the Fubini theorem there exists a set T, L(T)} = 0, such 
that, if tT, P{x(t) = œ} =0. Evidently 0¢T. 

Assume that toeT. Then tp > 0. We may take t, such that ¢,¢7,t) —t,¢T. 
Hence, 


P{x(to) > N} = lim P{x"(to) > N} 


a co 


= lim E{Px(t,)[x"(to — tı) > NJ} 


nm oO 
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el lim Px" Exo — 11) 2 ~i} 


nor 


= El lim Px(t,)[x(to — 11) > NI} 


=E{Px(t)[x(to - 14) > NJ} 


Letting N > œ we have P{x(to) = œ} = E{Px(t,)[x(ty — tı) = ©]} =0. 

(c) From fa) and (b) it is easily shown that X ¢ #, and that it is a non-minimal 
Q process. 

(d) We proceed to prove that X satisfies (6.11). In actual fact, let fi" be 
defined for X* in fashion (6.1) and (6.2). Because of (6.4), BX" f(n < k1). It is easily 
seen that there exist limits lim, „ 8%" = 8%, lim, ,. x"(B1") = x(B1). Furthermore 
on account of (6.4), x*(B4") = x" (8T). Thus, for 0 <j <n, 


P{x(Bi) = Jj} = PLET =F} = 


Hence the above formula holds true for j = — 1, too. 
(e) Suppose that X = {X(t),t < d}e#,(Q) also satisfies (6.11). By Corollary 2 
to Theorem 10.5.2, X is the strong limit of the (Q, V") Doob processes X” = g,(X). 
It follows that both X and X take the limit of the transition probability p7,(t) 
of the (Q, V") Doob processes as their transition probability, that is X and X 
have the same transition probability, and so they belong to the same process. 
The proof is terminated. QED 


12.8 SUMMARY 


Theorem 1. Assume that Xe {Q} is a non-minimal Q process. Then its 
characteristic sequence p, 49,7), (n > — 1) satisfies (6.10). 

Conversely, given a sequence of non-negative numbers p,q,7,(n2 — 1) 
satisfying (6.10), then there exists the unique non-minimal process Xe (Q) 
whose characteristic sequence is just the given sequence p,q,y (n> — 1). 
Moreover, we may take X as the strong limit of a sequence of (Q, V") Doob 
processes X”, where V” = (03,0 <j <n) is determined by (6.12) and (6.13) under 
P: 4d, Ya (n 之 一 1). 

For X to be honest it is necessary and sufficient that y~, =0. X satisfies the 
system of forward equations if and only if p = 0. 


It is still necessary to prove the last sentence. 

If X satisfies the system of forward equations, by Theorem 10.4.4, the U 
intervals in [1,0) are all „U intervals and hence P{x(ny) =j} = 0 and from (6.14) 
it follows that y; = 0 (j > 0). Consequently p = 0. Conservely, we assume p = 0. 
From (6.14) follows P{€, 9 < o} =O(keE), where €,; is determined by (10.4.1). 
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In addition, for je E, 


i a, 
Plu <o} [| < Pty <a} 


Therefore, on account of Lemma 10.4.2, 
P{éee <o} < >》 P{éi <0}=0 
k jeE 


By Theorem 10.4.4, X satisfies the system of forward equations. 


CHAPTER 13 


Relation Between Two Kinds 
of Construction Theories of 
Birth—Death Processes 


13.1 INTRODUCTION 


In Chapter 6 and Chapter 12, we have constructed conservative (ao = 0) 
birth-death processes by using analytical methods and probability methods 
respectively. We naturally ask: What is the relationship between the results for 
the two methods? We have completely solved the problem (Xiang-qun Yang, 
1965b}. 

In this chapter, we suppose that a, = 0 and the boundary point z is regular 
or exit. Moreover, we write X?(A) in (6.5.1) as X(A). Let X,(4) = Efe” *), t being 
the first leaping point for the Q process. 


13.2 CORRESPONDING THEOREMS 


Theorem l. Let the characteristic sequence of the non-minimal process 
XeX (Q) be p, q and r, (n> — 1). Then the resolvent operators of X are 


Da tabai(A) + dzX (An; 
Yil (A) = $3 (A) + X fA 4) roy ie ay r, [1 — X,(A}] + dzi SG X, (Ay 


where d is determined by (12.6.13). 


Proof. Let wi(4) be the resolvent operators of (Q, v") Doob process X”. Then 
by (11.4.5), we have 


dino % Seah (2) 
l= ei o Vk + En o% LI — X,(4)] 


We denote the fraction in the above expression as H(A). Substituting (12.6.12) 
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into Hi(A) and noticing $z- _, ry = |, we have 


H" (X,/A, ee oF PsA) + LY, H(X MAn DIA ni Cin PaflA) 
(A) = = aie 
7 (X „An -i + ( Xf a ae = Ag F. X,(4)] 

S VÈ Enri CudLl — X,.(2)] 
| -0rkPij(N) + (d/Cyo + oe ati Cm Pnj(4) = 
ea ore yall XA] + d/Cyo + FarCm[l — Xp] 
Sansa ee ee 


ryt YM D XA] + (d+ TerCo ft — X (AV Cro 


Note that Ag = Dig: Cio < 00, and d=0 if z is exit. By Lemmas 6.9.1 and 
6.9.2, we obtain 


Vale Pel) F dzX jA; 


Li e a ea 

n>a reat Yer] — X) da Ay 
Since X =lim,.,, X”, it follows that (4) = lim,- o ¥7,A}, hence the theorem 
holds. And the proof is terminated. QED 


By Theorems 6.6.1, 6.9.3 and 6.9.4, it follows that each non-minimal! Q process 

w{2) has the following representation: 
ap, (A} + DX (å) 
Vil) = Bud + XA) tints =! 
c+ Yall — XD] + DAY, X (ey 

where the row vector x >0 satisfies (6.9.5), constant D > 0, and furthermore 
D =Oifzisexitt. Moreover, >), %,,(4) + DX (Au; £ 0, and the constant c > 0. 

We point out that, except for a constant factor, the vector a, the constants 
c and D are uniquely determined by the process. In fact, suppose that a,c, D 
and &,č, D correspond to the same process, then 


apa) + DX (Au _ abl) + DXO)p 
A, A, 
where 4, =¢ + [%1 — X(A)] + DALX(A)p, 1], A, being the quantity correspond- 
ing to a, č and D. Multiplying both sides of (4) by 4I-Q, we obtain 


a/A,=a/A, 


(4) 


hence feat 
D/A, = D/A, 


Therefore K = A,/A, > 0 and is independent of å. Hence x = K& and D = KD. 
Again substituting into (4) we get c = Kč. 


Definition 1. The process in (3) is called a (Q, a, c, D} process. 


= (3) 


PROPERTIES OF THE PROCESS AT THE FIRST LEAPING POINT 359 


Theorem 2. The characteristic sequence p, q and r, (n> — 1) of a (0,x,c,D) 
process is 


=c I, =o, (n> 0) 
of! ifa=0 
~ | Agz/{Aoz + D), ifa #0 
i (5) 
(= | ei fa=0 
(Aoz + D) ifx#0 


where Ao =$; orCio. 


Proof. Comparing {1} and (3), we know that r, and 2, differ by a constant 
factor. We may as well consider r, = a, (n > 0), so that r_, =c and dz = D. From 
this (5) follows. The proof is over. QED 


13.3 PROPERTIES OF THE PROCESS AT THE 
FIRST LEAPING POINT 


On account of the corresponding theorem, it becomes clear how the (Q,a,c, D) 
process constructed by means of the analytical method moves and, moreover, 
some probability quantities of the process can be computed. 


Theorem 1. Let Xex (Q) be a (Q,a,c,D) process, and fp be determined by 
(12.6.1). Then the probability v7 = P{x(B))=j} (—1<j<n) is calculated as 
follows: 


ww | =(X,/A,)€ vi = (X,/A,)0; (0 <j <n) 
v = Y, + (X/A) È Cn (1) 
where 
< D/z ifa #0 
A= 2 Ci Ti id= 
d 
X, = -一 AnCno Yp =- o=— (2) 
(c +A Cro + d (c+ A )Cro +d 
pee ee if x =0 
A, cCiot+d 


Proof. The conclusion of this theorem follows from Theorem 2.2 and (12.6.3). 
QED 
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Theorem 2. Let Xex (Q) be a (Q,2,c, D) process, t be the first leaping point. 
That D> 0 or [x, 1] = œ is called case A; that D =0 and [2,1] < œ is called 
case B. Then for 0 <i < œ, 


0 
Pt =i}={ case A 
a/(e + La, 1]) case B 
Pit=a< o}=P{x(1)= 一 j= Ce 
ci(c + La, 1]) case B 
1 case A 
P\x(t}= co} = 
(te) | case B 
Proof. By (12.5.11) and the right-continuity of X, we obtain 
{x)= = lim {x()=i} -lgi<w 


By Theorem 1, we have 


P{x(t} = i} = lim Xa a; i20 


n> D n 


P{x(t) = — 1} = P{t = 0 < œ} = lim =e 


nm n 


But 
X a zCno ee 


An 2(C + A,)Cyo + D 
If D> 0, obviously, X,/A, 20. If D =0, then 


1 
E R 
A, c+A, c+[g 1] ' 
In fact, since A, = Dr-o% + EE p tCm it follows that, if [x,1] = œ, obviously 
(3) holds. If [x,1] < œ, then (3) follows from Z a4,C;,,<¥72,%70. Again 
noticing P{x(t)= oc} = 1—52 _, P{x(t) =i} we obtain the conclusion of this 


theorem. The proof is concluded. QED 
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CHAPTER 14 


Properties of Birth—Death 
Processes 


14.1 INTRODUCTION 


Birth—death processes constructed with the probability method have clear path 
structures. Every birth-death process ts the strong limit of a sequence of Doob 
processes. Therefore, in order to study the properties of a Q process we only 
need to study the limits. In this chapter we shall carry out this procedure by 
studying distributions of first return times. We assume a, =0 and adopt the 
notations given in Chapter 6, such as the increasing solutions u(4) and the 
decreasing solutions v(A); we also write 
X(a}= X?(4) = uA 
u(z, A) 


14.2 SOME FINE RESULTS OF THE MINIMAL PROCESS 


Assume that X = {x(t),t <o}e#,(Q), and that t is the first leaping point and 
ty is the first jumping point. Let 

ae <i <o,x(t)=i} (1) 

o if the above set is empty 

be the time of the process returning to i for the first time. Zi-kun Wang and 
Xiang-qun Yang (1988, section 5.2) have pointed out that there exists h = h(j) > 0 
such that for A> —h, E,{e~*"}\(k < j) are finite and are the unique solutions 
of the equations 


i 


Duy 一 A bly k <j 
uj= 1 (2) 


For k <j the moments , Nj, = E, {ni} = Efn, nj < t} (k < j) are finite and satisfy 
the relation 


j-i i 
Nyl > (2341 —-2;) y NG Hs (k <j) 

i=k s=0 (3) 
iNg= 1 
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Morcover Ni = E,{t'} satisfy 


NE =1y Giny—z) Y Niu, <BR k>0 
i=k s=0 
No =1 (4) 
Hence, one has 
í 
Efe-"} = A (k <j) 
aA | (5 
Ei{e “= X(N 4>0 
and 
w Ni. ; 
E,je™} = >} ( a (fA|<h,k <j) l (6) 
i=0 
When R < œ, 
7 æ N! . 1 
El{e = 7 (-Ay—* Jå] < 一 (7) 
i=0 i! R 
Now, fori<k < jandi+1< j, let 
Pril) = E, {eT <N; (8) 
2Prij (A) = Ey lemi, n< Ni} 
Nig = Extn ti < N} Nya = Ela <n) (9) 
1%jA) = Egge “i fi <rt} 29,;(4) = Bie" 4 < ni} (10) 
Nii = Edhi <1} Nui = Ex {tt <j} (11) 


Clearly, P,{ņ;Ît}= 1 as jfoo and, for i <k as jfo 
1 Pril) I 1 PxilA) Prisha) + Pril AT Pril) + Pril) (12) 
TiNa N; Nias ti Nut Nie (13) 


Nij kij t 


Theorem 1. (i) There exists h = h( j) >0 such that for A> —h ,¢,;;(4) (a = 1,2, - 


i<k < j) are finite, all moments ,Nj,, (a = 1, 2, 120, i <k < j) are finite and 
they satisfy the relations: 
Zya N iG i's) 


— Zy k 2; i=l 
Ni = -人生 > (z, 22) No it, ae < rs (zj; 一 


Zi S i+1 27™ Zis=k+1 
i<k<j 
Z.—2Z Zp 2; 
0 jk o 一 水 i 
WR e No, = i<k<j (14) 
Zj—Z Zj— Zi 


A e ah a he aE mamn inntimi ale ira ii aada Ei aa seta te marta Baa RSE meena ii a than thd a mtn a erty ai aa nn aa en aa o La aala 
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1N = ENI 4an N' 


iij fij i— l.i 


+baNi,, ij) 


N°. ee bizj— 2544 
1 iij ~ rere ete 
ra Qj 2,2; 


Nii wll Nig’ + biaNisiap - 


iij 


0 S = 2; 
2 二 
qi Zj 2; 


wuld = au 
i=0 I! 

(1) = DD = 0, 
OANA ~ (Dv (2) 
u, (Av fA) — u,(A)v, (A) 
u (AvA) — u,{A)v,(A) 


(i<k<j, [Al <h) 


(1>0,i<k<)) 


2pri(A) = 


l u; (A) 
1Pij(A) = ele (a) +b Pia a) 
7 1 . (A > 0) 
29iii(4) = oe biz Pis ajl) 
(ii) Fhe following also hold: 
WÁÀ : À 
ER i 
¥,(4) v,(A) 
1 f wid), a) 
iA) = ee eh Sis A>O 
re AG ua) vA Š 
: b; Vi41(A) 
(A) = —— X; 从 一 天 (从 -一 二 一 0 
2Pii(A) e( +104) (A) (A) A> 
I z—-z * _ 20 
aN, =! ee >. (Zs — ZN "Hs + > (z— 2) N? p 
i Sal 2-2, s=k+ł ao oak : 


<[R'"'N, < IR! {i<k,a=1 or R< œ asa=2) 


iNQ=—=* Ng == (i <k) 


(i< k, À >0) 
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(15) 


(16) 


(17) 


(18) 


(19) 


(20) 


(21) 


(22) 
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Ni = = oh Na ' +a Ni- 1a tba Nisip) SUR 
ai b;z— 2 (23) 
Menpe a 3 | 
qj Gi Z— Zi 
1 
N= (I, N; 1+ biNi,) i) S < IR! 
a; 
bi Zisi — Zi (24) 
Ween 
When R < x, 
om yen 
aPu(A) = at= (i > k, |å} < 1/R) (25) 


Proof. (i) Since for 2 > — h, E,{e~*"} {k > j) and E, {5} (k < j) are finite, it 
follows that ,@,,;(4) and Ny are finite, and by Wilks (1962, p. 14), 
t 


d 
aN =(— 1)' i Paul) pte (26) 
and {17) holds. 

The formula (19) follows from the strong Markov property. Multiplying both 
sides of (19) by {4 + q,), differentiating them | times and noting (26) and (5)-(6), 
we obtain the first expressions of (15) and (16). Obviously, 


a; b; 
1Nij = Piing<nj}= = UR 


l i 


b; 
Nij = Pig {j <M} 
qi ; ‘ 
Therefore the second expressions of (15)-(16} follow from (12.2.8). 

Making use of the strong Markov property we find that ,@,;;(A) (<k < j, 
A > 0) satisfy the following equations: 


u; = {1 —(— 1)*]/2 
(A + ay + be — ayy 1 — Py,» =O (< 大 < 及 
由 = [1+( 一 DeJ/2 
Solve the above equations to obtain (18). Differentiating the above equations 
and noting (26), we see that u, = aN ys (i<k <j, l2 1) satisfy equation (5.4.11) 
with f;=0, fi =l Npp (<k <j) and f,=0. According to Theorem 6.2.3 and 


(5.4.12) the first expression of (14) is justified. The second one follows from 
(12.2.8). 
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{ii} On account of (12), let jf 20 in (18)-(19) to obtain (20)-(21). 
When R < œ, by (7) for k >i we have 


Nii t aNE = E,{min(y,, t) y} < Egt < NR! < oo 


Hence (25) holds. 

The second expression in (22) follows from (12.2.16). From (13) we can obtain 
(23) and (24) merely by taking limits in the corresponding expressions in (i). Let 
J] œ in the first expression of (14); then according to the monotone convergence 
theorem we find that (22) holds for a = 1 and that if we substitute , Ni; + 2Nijs 

NED} +N"! for Nla Nt’ respectively in (22), the corresponding formulae 
still, hold and IN} +N}, < UR! < œ. Therefore for a = 2, (22) also holds. The 
proof is completed. QED 


Theorem 2. The minimal solution is recurrent if and only if z= œ; more 
precisely, 


ms 2—2)H, 上 > 
| d= tim 8,42)=Ty= 4) 2); a (27) 
0 Alo (z — zik ifj<i 
Proof. It follows from (6.3.2) that 
u{A) 1 (A {0) (28) 
By (6.3.4) v(A)—> SF (2541 — z) =2— z as A] 0. So (27) follows and the proof 
is completed. QED 


Theorem 3. Suppose z = œ. Then the minimal solution is ergodic if and only if 
Dizol < ©. 


Proof. According to (12.2.17) we have ,Nj_, ; = m,_,. When z = œ, by (22)-(23) 
it follows that ,N? = 1 and 


Ein = Nu “(+ am, t+ baNir ,i) 


1 
1 
Niii 一 (2i+1 一 2 Us 
s=i+] 


Hence E,{n;} < oo is equivalent to E2 g u, < 20. QED 


Theorem 4. Suppose R < œ and S < œ. Then 


lim 19n(4) = Xl) i>0 (29) 
n>% Z~Z, Vi(N) 


tim = 2Pnil4) =AD A jean 


1>0 (30) 
n> aD Z—2Z, v (A) 
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Proof. According to Lemmas 6.9.1 and 6.9.2, (29)--(30) are deduced from (20) 
immediatety. QED 


143 INVARIANT MEASURES OF THE MINIMAL PROCESSES 


Suppose R < œ. If a process is recurrent, it must be honest. Conversely, 


according to Theorem 12.4.2 an honest process is recurrent and ergodic. We . 


will find the invariant measure. 


Theorem 1. Suppose X is a (Q,a,0,D) process. Then its invariant measure is 


Ya; + Du; 
k 
z; = lim p,,(t) = —- = (1) 
i a da N+ DY u 
k x 
and 
aly + Dy; 
m = Ey, = --——_-___-—— (2) 


a{ Dan, + DPA ) 
k 
Here Tj are determined by (2.27) and N, by (6.2.6). 


Proof. By (7.7.10) we know that the limits in (1) exist. By Tauber’s theorem 
(Hardy, 1949, Theorem 98), lim , jo AYi,(A) = lim, _, ,, p;;(t). Because Pifr < œ} = 1, 
XA) = E{e~*} 41 as ALO and 
1 — X (4) 
A 


2 PADTY T=N, as A4|0 
j j 


Note that D = 0 if z is exist, and $, u, < oo if z is regular. Therefore (1) follows 
from (13.2.3), and (2) follows from (1) and (7.7.10). We conclude the proof. 
QED 


Theorem 2. Suppose that Xe (Q) is a (Q, a, 0, D) process and z is its invariant 
measure. Suppose that functions f and g satisfy X| | 区 < oo， > lg@){ 12; < oo 
and >); gln; #0. Then 


| ree 5 fm, 
P lim = 云 一 一 =1 (3) 
ie | gxt]dx 80% 

0 


Proof. See Zhang-nan Li nd Rong Wu (1964), Theorem 3.1). QED 
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14.4 DISTRIBUTION OF THE FIRST RETURNING TIME 


Theorem 1. Suppose that Xe#,(Q) is a (Q, x, 0. D) process and njis defined by 
(2.1). Then for A> 0, 

Ee- mt Gc (1) 
uj(4) 


Ele ‘Vv}=1— m(A)(A +q)? be + xag ar PyA) + Da.) | 
k 


(2) 
E,{e7 Ans} = | wma 十 xaS aD, ;(A) + Dx) | 
-1 
[rasa F XA Zabul + Dx (2m) | (i> jf} (3) 
where 
m(A) = Lall — X (å)] + DA > X fA) iy (4) 


or equivalently, 


Ele n = 9.0 i : uå) S Vel 4) xe) 
der 0s) 040 È aire Fa Mes plat 


J W x F -1 
[2 a, + ae a( 1 — X, (A) + x9) | (i> j) (5) 


where ,pi;(4) are determined by (2.20) and (2.21). 


Proof. The formula (1) is just (2.5). By the well known formulae in Chung 
(1969a, pp. 192-3), 


t 
pult) = e71 + | Pult — u) dP; (4; <u) 


0 
i 
p=] pilt —u)dP, (n; <u,i¥ j) 
0 


Taking Laplace transformations, noting (13.2.3) and making some simple 
rearrangements, we can obtain (2)-(3). 

Now consider (Q, V"} Doob processes. Let G, be the hth leaping point of X. 
By recurrence Pi{n; < œ} = 1 for i> j. It follows from the structure of Doob 
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processes that 


Pile 4%} = Efe", N; <o} + 2. Be ES Ni Orin) 
h=t 


w o0 h-1 
= 9+ ¥ Efe oa < nf DS eee, <n) 
h=1 


k=it+i 


j-i xX 
( > De Erle 2”) + 0, + by nE sn) <0,)) 


h=0 k=j+1 


j 1 x: Eg 一 ! 
= 0918+ 20,10 » ee » ae => vaud) 


k=0 u;(À) k=j+1 v,(A) k=j+1 
= puli) + sot y Dy ay J v at) 


; irae 
k=0 uj(À) xk=j+i ¥,(A) 


i Es -1 
( Xot 2 ofl -aputa ) (6) 
k=0 k=j+1 

For a general (Q, a, 0, D) process X, it is the strong limit of a sequence of 
honest (Q, V”) Doob processes X”. Define n; and n? for X and X", respectively. 
Then y? fn; as nf oo. 

Substituting V” in {13.3.1} into (6), letting noo and noting (6.9.2)-(6.9.3), 


(2.30) and (2.20) we can obtain (5) by a simple calculation. The proof is. 


terminated. QED 


CHAPTER 15 


Recurrence and 
Ergodic Properties 


15.1 INTRODUCTION 


The recurrence and ergodic properties of processes are extremely useful for the 
study of approximation properties of their transition functions at infinity. They 
are also important for the study of excessive functions, zero—one law (see Zi-kun 
Wang, 1964, 1965c, 1966, 1980) and reversibility (see Min Qian and Zhen-ting 
Hou, 1979). General studies for the classification of Markov processes have 
been summed up in Chung (1967, II, section 10). Li-de Wu (1965) and Miller 
(1963) studied the classification of states of minimal Q processes and found the 
necessary and sufficient conditions related to the Q matrix, under which Q 
processes are recurrent or ergodic. 

This chapter studies the classification of states of Q processes, which is closely 
related to construction theory. This kind of classification depends not only on 
Q but also on the construction of processes. Hence, different constructions need 
different treatments. The content of this chapter is derived from Xiang-qun 
Yang (1980d). 


15.2 TWO LEMMAS 


We call i, w(A)-recurrent or ergodic if the state i is recurrent or ergodic with 
respect to w(A). We say a process is recurrent or ergodic if all its states are 
recurrent or ergodic. Obviously, iis y(A)-recurrent if and only if lim, ,ow i(2) = œ. 
By (7.7.9) and Taubers theorem, i is w(A)-ergodic if and only if 
lim, (o4W;,(A) = 2; > 0. And in terms of m; defined in (7.7.8), we have 


n; = /qimi (1) 


In the following, the notation i9; means that i may reach j with respect to 
W (å) (i.e. there exists 2>0 such that w; (A) > 0). We always have i W; 


Suppose X ¢#,(Q), t, and t are the first point and leaping point, respectively. 
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Lemma 1. As A410, 


$,()1T = 2 A a (2) 

g(a) = Eje- E) té; Pile <0} | (3) 

Sa tn, =$ Tys Et (4) 
de 

éA} = 1 — Ad fA) (5) 


Proof. The formula (2) is just (2.10.28). The inequality F;; < T; follows from 
Theorem 7.2.1. Imitate the proof of Theorem 7.12.3, and we obtain 


AY. bd) = 1 ~ Efe *) (6) 
J 
Comparing this with (5), we obtain 上 (从 = E;{e7*%}. Moreover (3) is proved. 
Finally, 
1 — ¢ (A) : eee 
-=T =F hA) E, | | ar} (7) 
i 0 
From this (4) follows. QED 


Lemma 2. Suppose X is a w(4)-process and i is ¥(A)-recurrent. Then P;{o = 
oo} =1. If i is y(A}recurrent and $(/)-non-recurrent, then P;{t < co} = 1. 


Proof. The first claim is clear because if i is w(4)-recurrent, then on {x(0) =i} 
x returns to i for infinitely many times. But according to Theorem 7.7.3, the 
nth sojourn times at i, p? (n2O0), are independent of each other. So 


C2 > op =O. 
By Theorem 7.7.4, if i is Y(A)-recurrent then 


Pi{ X(w) has infinitely many i-intervals in [0, 00)} = 
If i is @(A)-non-recurrent, then 
P;{X(w) has only finitely many i-intervals in [0, t(w))} = 1 
Therefore P;{t < œ} = 1. We conclude the proof. QED 


15.3 DOOB PROCESSES 


Theorem I. Suppose (A) is a (Q, z) Doob process and i is #(A)- non-recurrent. 
Then i is w(A)-recurrent if and only if é; = 1, È, %,¢, = 1 and there exists k such 
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that z, > 0 and 
Si (1) 
If i is w(A)-recurrent, then i is ergodic if and only if 
LTN, < 90 (2) 


Remark 


Because yn, < 1 and č; < 1, if(1) holds, necessarily Dn = 1,1.e. Y (4) is honest. 


Proof. From the hypothesis, T; < oo. By Lemma 2.1 let å }0 in (11.4.5) so that 
we find that 


Ald 


Suppose that i is y{4)-recurrent. Then the left-hand side of (3) is infinite. 
According to Lemma 2.2, €; = 1. Moreover, surely 


AN S (ÈA) < oo 
k 


and is positive, for otherwise (3) becomes lim; | o Wii(4) = Tu < œ, a contradiction. 
Since > FE > 0, it follows that there exist z, > 0 and I; > 0. But the latter 


is equivalent to kti. Hence (1) holds. Conversely, by (1) it follows that the 
right-hand sde of (3) is infinite. 
Suppose (1) hold. It is derived from Lemma 2.1, the remark of this theorem 
and (11.4.5) that 
Y 1, PxiA) 


k 


im AO) edi G0) 
He Wi) pt im i Smell Saye 


It has been pointed out that the denominator of the right-hand side of the 
above formula is finite and positive. Hence the y(A)-ergodic property of i is 
equivalent to (2). The proof is finished. QED 


Corollary 1 


Suppose for any i, j,i ay j and ġ(å) is non-recurrent. Then a (Q, n)Doob process 


is recurrent if and only if $, a,¢, = 1. If the process is recurrent,then it is ergodic 
if and only if (2) holds. 


if! 


F 
H 
i 
i 
j 
j 
| 
l 
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Proof. The necessity for recurrence is clear. We now prove the sufficiency. As 
a Té, = 1, there surely exists some i such that z; > 0 and č; = 1. Hence for this 
i, (1) ts satisfied, and so i is W(A)-recurrent. On the other hand, obviously j 
for any i,j for any i, j; therefore y(A) is recurrent. 


Corollary 2 


Suppose for any i, j, i j and Q is single exit. Then a (Q, z) Doobprocess is 
recurrent if and only if it is honest, i.e. OQ is conservative and >, 2, = 1. 


Proof. For single exit Q, P;{t < oo|x(t -O)eB,} = 1. Therefore by Theorem 
7.12.8, & = Pi{t< o}=1 and the condition ¥,7,é, = 1 becomes ¥,7, = 1. 


QED 
15.4 SINGLE EXIT PROCESSES 
Lemma 1. For y(A) and č given in Lemma 2.11.4 
A[n(A), 6} 10 as 410 (1) 
Proof. It follows from (2.11.40) and the property €(A)Té as A 0. QED 


Theorem 2. Suppose w(A) is a process in Theorem 3.2.1 and i is @(4)-non- 
recurrent. Then i is y{4)-recurrent if and only if 


X,>0 Zayi >0 c=[a,X°]+4°=0 (2) 
If i is y(A)-recurrent, jue i is W(A)-ergodic if and only if 
k 
where 4,(A)T ñ; as 410. 
Proof. Imitate the proof of Theorem 3.1. It suffices to note that from (2.11.7) 
[X -RAVE DRTE A0 


and to apply Lemma 1. QED 


Corollary 


Assume that Q is conservative and single exit. If for any i, jEE, iS jand fA) 
is non-recurrent, then w{A) is recurrent if and only ifc = [a, X°] + ° =0. 


E(aDruk+ ak) < co 3) 


i rill A Pr td 
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15.5 FIRST-ORDER PROCESSES 


Suppose X = {x(t),t<a}e# (Q), ie. X is a first-order process. It is a {x(a,°), 
acB,.}-generalized D-type extension process of the minimal Q process 
XVS) so: t<t}, where x(a,:) satisfy (11.6.2). For this reason we call X a 
{Q, x(a,-), ae B,} first-order process. 

For a in this section we assume that the non-atomic exit boundary 
B., induced by Q is empty. That is, the exit boundary B, entirely consists of 
atomic boundary points; simply put .o = B.. 

By (11.5.26) the resolvent operator (A) of a {Q, n(a,°), ae s } first-order process 
has the following representation: 


Wi (A) = + 2 2 XAG (AAU (1) 
ae. bes 
where 
X (4) = Efe ~, x(t — 0) =a} AXA) = ¥ nib, by (A) 
k 
Val) = 2 (a, k)X f(A) 
(2) 
¥ (A) = {V aA) } (VA) } = (VE A} are f x .% matrices 
Gu 人 = X VE A) 
1=0 
If we set 
= {ilieE, there exists ae. such that x(a, i) > 0} (3) 
then obviously 
n(a, E — A)=0 acd (4) 
and the formula (1) can be rewritten as 
yl) = Qul) + y >: Zil À)D AAI (A) (5) 
reA geA 
where 
= 》 X%A)n(a, q) ic¢E,gqeA 
ae sf 
X (A) = {Z,,(4)} (ZAY = {ZA} are A x A matrices (6) 


D,(å)= > Zi (2) 
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Clearly, as 410 


XA) PX? = Pif x(t- 0) =a} ASTAS = > ala, KT 


k 


VATI = p n(a,k) Xt} Ct 
k 


ZigQA)T Zig = > Xin(a, q} {VT (7) 


acA 


GAIG= > ¥' BAYIG= 》 YZ 

f=0 i=0 
Again obviously 2(4), 2 and ¥ (A), ¥ may be considered as one-step transition 
matrices of Markov chains on the state spaces .% and A, respectively. Hence 
we can say a is ¥ (A}recurrent, and so on. Thus it follows from (2.2.10) that 


Gali) EG Gas Go 
Dig (A) < Dasl)) D, < Dya 


Lemma 1. (i) Suppose for some a, be, lim, jo4G(å) = 0 and a =b. Then 


ALO Ajo 


lim 2G,,(4) = lim 2G,,(4) = lim AG,,(4) = 0” 
Ajo 


(ii) Suppose for some r, ge A, lim, ))4D,,(4) = 0 and rq. Then 


lim 2D,,(A} = lim AD,,(A) = lim 2D,,(A) = 0 
Ato Alo Alo 


Proof. It suffices to prove (i). By the hypothesis, there exist a, 8 such that 
V2,V? > 0. However, by Chung (1966a, remark on p. 22) 
Vere) > VE AVE AV (A) 
It follows that 
at p 7 
a 6%) — >, via) > VE (AAG aal) VE, (A) 
i=0 
Noting (7) we have V2 (A)V3,(A)t VE, VZ, (410). Therefore 
lim AG,,(A) > V£ lim ÀG (À) V2, 
ajo alo 


And so lim, )94G,4(4) = 0. Then by (8) we have completed the proof. QED 


Lemma 2. Suppose w{A) is a {Q,x(a,-),ae./} first-order process and i is 
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@(A}-non-recurrent and w(A)-recurrent. Then: 


(i) if XF > 0, a is ¥ -recurrent; 
(ii) if Z, > 0, r is #-recurrent. 


Proof. (i) Suppose X is a (A) process and qt" is its nth leaping point for each 
n. It follows from the structure of the first-order processes that x(t” — 0) (n > 1) 
and x(t") are ¥ -chains and #-chains, respectively. By the hypothesis and 
Lemma 2.2 


Pi{t<œ}=P {a= %0}=1 (9) 


Let ð = 0, 8, =1, 6, be the time that X first returns to i after Bo, and f, be 
the first leaping point after 6,. Then by (9) and the (A)-recurrence of 
i, P;{d, < oo} =P; {B, < oo =1 Let 6, be the time after 8,_, that X returns 
to i for the first time. Let f, be the first leaping point after 6,. Then it can be 
proved that Pi{6, < œ for all n} = 1. 

It is easy to see that {x(f, —0)=a}eF, OF an, By Theorem 7.7.3 they are 
independent. By the strong Markov property 


P,{x(B; — 0) = a} = P,{6, < o, 0,,[x(t —0) = a]} = X7 >0 (10) 
Hence it follows from the Borel—Canteili lemma that 
P,{x(B, — 0) =a for infinitely many /} = 1 
and of course 
P;{ x(t — 0) =a for infinitely many 1} 
= $ X?P{x(t'—0) =a for infinitely many [/x(t')=b}=1 


be of 
Since Xz > 0, it follows that P {x(zt' — 0) = a for infinitely many I/x(t!-0)=a} = 
1, i.e. a is ¥ -recurrent. . 
(ii) The proof is similar to (i). The left-hand side of (10) is replaced by 
P;{x(B,) =r} = Z, > 0. Hence P;{x(B,) =r for infinitely many /} = 1 and it goes 
without saying that 


P;{x(t') =r for infinitely many /} 


= f Z,,P;{x(t') =r for infinitely many [| x(t’) = q} =1 


qeA 


Since Z, > 0, it follows that P;{x(r') =r for infinitely many [}x(t'} =r} = 1, ie. 
r is Z-recurrent. And the proof is completed. QED 


Theorem 3. Suppose W{A) is a {Q,x(a,-), ae} first-order process and i is 
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#{A)-non-recurrent. Then: 


(i) i is y(A)-recurrent if and only if there exist a, be. such that X? > 0, 4°>0, 
a is ¥ -recurrent and a Sb! 


(ii) i is y(A)-recurrent if and only if there exist r, qe A such,that Z, >0,r = q Bal 


and r is Z -recurrent. 


Proof. We need only prove (i). Let A] 0 in (1) so that 
limyad=Tit 2 2 X7G A? 
Ajo 


aed bes 


一 工 :十 ae X Jam A? (11) 


a,be.f 


where 5 * means that the summation is taken over positive summands and Gab 

is the probability that a ¥ -chain starting from a reaches b after finite steps (> 0). 
If i is w{A)-recurrent, then the left-hand side of (11) is infinite, and so there 

must exist abe such that X? >0, ga >0 and A?>0. By Lemma 2, a is 


¥ -recurrent. But g,, > 0 precisely demonstrates a = b. 


Suppose the sufficient conditions are satisfied. If a = b, then gw = 1, Gua = © 
and the right-hand side of (11) is infinite. If a 4b, then since a is ¥-recurrent 


and a= b, ice. Ja > 9, it follows that b is also recurrent, i.e. G,, = co. Therefore 
the right-hand side of (11) is also finite. We conclude the proof. QED 


Theorem 4. Suppose for any i,j, is j and (A) is non-recurrent. And suppose 
WA) is a {Q, x(a, 小 ac. } first-order process. 
(i) If y(A) is recurrent, then naturally 

Ci = | (iek) 


where č; = P;{t < oc} is the same as (2.3). 


Q is conservative na, E) = 1 (ae) (12) 


(ii) If (12) holds and so does one of the following: (1°) .of is finite; (2°) A is finite; 
(3°) .oz has at least one Y -recurrent state; (4°) A has at least one #-recurrent 
state; then w(A) is recurrent. 


Proof. (i) By Lemma 2.2 €;= P,{t < œ} = i (icE) and P;{¢ = œ} = 1. Hence 
Q must be conservative. Therefore, for aes, by (11.6.2) we have 


¥ na, k) = > P{ x(t) = kj x(t — 0) = a} 
k k 


la and b may be the same, a 5 a. 
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(ii) Suppose (12) holds. Under the hypotheses of the theorem, surely Xf >0 
and Af >Q for all ae.w, ie E, and so Z,,>0 for all ick, re A. Because 


》 Vay = > nak) >》 X=} nla kg, = 1 
k be .f k 


be. 
È 2u= 5 XY nage 工交 = 和 = 
qeA ac geA dew 


if one of the conditions (1°)}-(4°} holds, we can deduce that a (e A) is ¥ -recurrent 
and y {EA) is #-recurrent. Thus the sufficient conditions in Theorem 3 hold. 
Hence w{/) is recurrent. The proof is completed. QED 


Theorem 5. Suppose i is $(A)-non-recurrent and (A) is a {Q, 2(a,-), ae } 
first-order process. Suppose 6 = sup,, y Tla, E) < 1, then iis W(4)-non-recurrent. 


Proof. By the hypothesis we know that Ti S T; < o. Since 


》 XN XS 


ace ac of 
it easily follows by (7) that 
A?(A) = £ níb, k)F pi < ôT i; 
k 


D Ti A < 6! 


It follows from (1) that 


Vi) < Tit YX); < 


From this we know that i is y{A)-non-recurrent. The proof is finished. QED 


Lemma 6. Suppose Ya is a {Q, x(a, -), ae.% } first-order process and for any 


i,j, jj. Then 


(i) if x(a, E) > 0, then a >b (bew); 
(ii) for any r, ge A, rSq. 
Proof. Suppose X is a W{A) process and n* is defined as in (7.6.7). Because i 
and j communicate with each other, with respect to w(A), we have 
u; = Pi{n* <a} >0 (13) 
(i) By the hypothesis there exists i such that x(a,i)>0 and for be. there 
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exists j such that X? > 0. Thus 
P {there exists / > 1 such that x(ct'— 0) = b|x(t' —0) =a} 
> nla, iju; X? > 0 
ie. a Sb. 
Claim (ii) can be proved similarly and the proof is completed. QED 


Theorem 7. Suppose that Ņ(å) is a {Q, z(a, as } first-order process, for any 
i, j,i SS j, (A) is non-recurrent and (A) is recurrent. Then 


(t) if A is finite, wy (4) is ergodic if and only if 
N, = E,t < 00 keA l (14) 

(it) if Z is finite, y(A) is ergodic if and only if 
x(a k)N, < oo ac. (15) 


k 


Proof. We only prove (1). Claim (ii) can be proved similarly. Since y{A) is 
recurrent, by Lemma 2.2 y{2) is honest. Le. 


ADWA =! icE (16) 


Q is conservative since (A) satisfies the system of backward equations. 
According to Theorem 3 there exists re A such that r is 7-recurrent. By Lemma 6 
A isa #-recurrent class. Substituting (5) into (16), considering (1.5) and noting 
that ¢,(2) =>)... XS (4) if Q is conservative, we arrive at 


y XA = YX) E aa rad, (49, pA). 


ae. ae. rge 


It follows from the linear independence of X“(A) that 


l= 》 axlar)aD,,(A> o,(A) ace. (17) 
j 


r,qE 


(a) If there exists some geA such that N, = œ, then for this q there exists 
ae. such that x(a, q) > 0. By (17) 


na, g)AD (4) 2 Pal) < | 


< eee 
n(a,q) Yj Pai) 


It follows that him, | )4D,,(2) = 0. By Lemma } for any r,qeA, lim, |,4D,,(4) = 0. 


Hence by (5) and the finiteness of A we have lim,),AW;(A) =0, ie. (A) is 
non-ergodic. 
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(bj Suppose N, < % for all k. We might as well assume that lim,,,4D,,(A) 
exist for all r,ge A. Otherwise we can always choose a suitable subsequence of 
2. Then by (17) and the finiteness of A, 


1 = > n(a,r) lim AD WAVY Ta 
j 


riqeA Alo 
= y 2 na, r) ii AD, AAT a acd 
J rge 


Consequently for fixed ae.sy there exist jeE and r,qeA such that 


z(a, r) lim AD,,(A)F-,; > 0 
Alo 


But for ae. there must exist i such that X¢> 0. Therefore by (5) 


ri = lim Ay, (a) > lim z;,(A\ADiq Ag (4) 
Alo Ajo 


> Xina, a( lim MpaO ) I,;>0 
240 
i.e. (A) is ergodic. The proof is concluded. QED 


Theorem 8. Suppose that the non-atomic exit boundary B. induced by Q is 
an empty set and of = B, is a finite set. Then any D-type Q process Xe p(Q) 
is a {Q, z(a,'), ae. } first-order process, where 


P{x(t)=j|x(t — 0) =a} = x(a, j) (18) 


Here +t is the first leaping point. 


Proof. Since X EH n, it follows that 
P (t) = P,{x(t) =j, t <t} + Pi{t<t,x(t)=j} 
= f(t) + y 》 Pi{x(t — 0) =a, t St, x(t)= k, x(t} =j} 
ae k 


Making use of the strong Markov property and applying Theorem 7.17.1, it is 
easy to prove that the summand of the above is equal to 


t 
| put -DAP,= | put- 9AP -0 = a,x(0)= kr <5} 
x(r-O}=a 0 
xit)= karst 


x Pi{x(t—0)=a,x(t)=k,t<s} 
= P,{x(t —0) =a, t <s}P{x(t)=k|x(t —0) =a} 
= L*(s)n(a, k) (19) 
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Thus (19) becomes 
PAO = f yl t) + X 》 x(a, k) k) | Palt 一 sjdl. 4(s) 
aéest k 


Taking Laplace transforms we have 


pl) = plà) + y Xi( AVY x a, ky, (A) (20) 
ac Ff k 
or 
HUA) = GA) + {XB (21) 


where BS(A} = Enla, k)y,;(4). Upon multiplying the above on the lefts by x{a,°) 
we obtain ` 


(BA) = {A} + OBO ss 
(= FA} {BW} = (40) 


where A%(A) is defined as (7) and .of x .% matrix ¥ (A) as (4.2). Because the 
matrices ¥ {4) have row sums Lobe. yn Ta, K)X P(A) < t and of is finite, for each 
A>0, {f—¥{4)} 7! exists and is equal to (A) = F(X (Hi Therefore by (22) 


(BAS =U — FW NA} = AA) AT)} 


Substituting this into (21) we find that Ņ(å) have the form (1), i.e. y(A) is a 
{Q,n(a,:),a€.0} first-order process. The proof is complete. QED 


Remark 


Many results in this section can also be extended to kth-order processes. 


15.6 BILATERAL BIRTH-DEATH PROCESSES 


In this section we shall utilize the notations given in Chapter 5. 
Suppose that X is a bilateral birth-death process and 1 is its first leaping 
point. Define the first hitting times č; according to (12.2.6). 


Lemma Í. Suppose i < k <n. Then 


PAS <E}= et PE <} (1) 
Zn i Zn Zi 
Proof. Imitate the proof of Theorem 12.2.2. QED 


Theorem 2. Let C,, denote the probability that the process X starting from k. 
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reaches n after finite (> 0) jumps, ie. C,, = Py(é, < T} Then 


— 1 i < 
a H 2, )Mr2 — Zn) un <k (2) 
(2r ~ rinra) ifn>k 
Proof. It follows by letting n> + œ or letting i> — % respectively in (1). 
QED 


Theorem 3. The minimal Q process is recurrent if and only ifr, and rz are both 
infinite. 


Proof. The probability that the process X starting from 0 returns to 0 is 


Hence by (2) we can see that f* = 1 if and only ifr, and r, are both infinite. 
The proof is completed. QED 


Theorem 4. Suppose that the minimal © process is recurrent. Then it is ergodic 
if and only if 


2H <% (3) 

and in this case 
= mi=( Se) (4) 
人 ifj>i (5) 
Mea, 2a Ae Zs + (zi ~— 2; ) È Hs Hj<i (6) 


where m; = Ein*, where nt is determined by {7.7.7). 


Proof. Consider a minimal Q process X = {x(t),t < oc}. Note that by recurrence 
we have P,{y* < co} = P,{&, < 00} = 1. It is easy to see that for i <k <n, u, = 
min(é,,é,) satisfy the equations (5.4.11) with f, = f =0 and f,=1(i< k <n). 
Hence it follows from (5.4.12) that 


E,min(é,,¢,)= > G 区 一 到 如 一 到 + È (2 ~ Fen = Zn 7), (7) 


5 
i<s<k Za 2; k<icn Zy Zi 


Letting i> — 00,n— + % in the above expression and noting that r, and r, 
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are infinite, we obtain (5)-(6). By the strong Markov property 


] oa, 
My = + Mga toMa 
di di i 
Noting that a,(z;— z:-1)} = 5,(z;, , — z) = u7 ' and substituting (5) and (6) into 


the above, we obtain (4). The proof is completed. QED 


Lemma 5. If the minima! Q process is non-recurrent, then 


Np Ce a e 


s<k 7 一 六 k<s 六 一 六 


S 


Proof. It follows by letting i- — œ and n> + œ in (7). QED 


Theorem 6. Suppose that r, is entrance or natural and r, is exit or regular. 
Then a Q process (4) is recurrent if and only ifr, is inifinite and y(A} is honest. 


Proof. This theorem is a special case of Theorem 4.2. Under the hypothesis, 
X;=X? and X? = X}. Thus the first two inequalities in (4.2) hold. Therefore 
(4.2) is equivalent to c=0 and X°? = X!=0. By noting (5.7.2) our proof is 
finished. i QED 


Theorem 7. Suppose that r, is entrance or natural, r, is exit or regular, and — 


¥{A) is recurrent. Then 

{1) if r; is exit, then y(A) is ergodic; 

(ii) if r; is natural, (1*) when > ous < oo then ws) is non-ergodic; (2*) when 
Ds <ols < ©, and WA) has the representation (5.8.3), then y(A)} is ergodic if 
and only if 


Y aN, < oo (9) 


s=0 


In particular, if ) coks < © and 3 ,coasdrz — Z) < œ, then (4) is ergodic. 


Proof. Letting 410 in (5.8.12) we have l 
fi = P(r. ~ zu; + Pow; in which P, = Oifr, is natural 


ar (10) 
and P, = Oifr, isexit 
But r, is regular or exit and, moreover, 
¥ (ry — 2) uj < ec ifr, isentrance 
oe (11) 
>, By < 0 ifr, is regular 


$20 
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Hence $; <œ is equivalent to P 5, col < %. Note X= X?=1, so the 
ergodicity condition (4.3) becomes 
aN, +P, Y p< op (12) 
5 s< 0 
Because, by Theorem 6, r, is infinite, by (8) 
N, = (rz — 2,) ry Hs + >. (rz 一 2 (13) 
s<k 


kes 


We now proceed to prove that if È <oks < ®©, then 


X aN, <œ (14) 
520 
In fact, when k > 0 
N, = (ry — Zz) ` Hs + M, (15) 
s<0 


where M, is just N, in (5.11.11). It follows from Theorems 5.11.3 and 5.11 4that 


X aN; < 20 
k20 
(i) If r, is entrance, then surely > colts < 00. By (14) the ergodic property is 
equivalent to (9). But when i <0, by {11) we have 


Ni< > (r2 — Z,)u, + E (r2 —Z,)us= > (r2 ~ Zz) < oo 
k<s 


sk 5 


Hence by Theorem 5.11.5 


pA ani<( > a) Str — Z) Hs < © 
iso iSO S 
Therefore (A) is ergodic. 

(ii) Suppose r, is natural. (1*) Suppose È < gH, < œ. By (13) N; = 0. Ifa #0, 
then {12) is not satisfied. If a= 0, then necessarily P, > 0. Hence (12) is not 
satisfied, and so yA) is not ergodic. 

(2*} Suppose Ð ou, < co. By (14), the ergodicity condition (12) becomes (9). 
Furthermore, suppose >”, oa(r; — z,) < œ. Then by (13) for i <s, 


NiS) Vast Y (a= zJu + ¥ ty zn 


s<i i<s<0O s20 


<(r,—-z) $ u+ 2 (rs — z)h 


s<0 s20 
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By Theorem 5.11.5 we have X, <94@, < %. Therefore Dc oadN, < %, and so A) 
is ergodic. The proof is terminated. QED 
Theorem 8. Suppose that r; and r, are regular or exit. Then: 


{i) the © process y{/) is recurrent if and only if it is honest; 
(ii) any honest Q processes are ergodic. 


Proof. By Lemma 2.2 w(A) is recurrent, so it must be honest. 
First, we prove that if the vector x > 0 satisfies ap(/)el, then 


by aNg < DC (16) 
k 
where N, is determined acording to (8). When k > 0 from (8) it follows that 
Z, —F 
Niso YO nt M, a7 
s<0 F2 cd ry 


where M, is precisely N, in (5.11.11). By Theorems 5.11.3 and 5.11.4 we have 
Deeo%N, < ©. Similarly $, <94,N, < oo can be proved. - 
Next, for 7,(A) defined in (5.7.12), let 4] 0. We obtain , 


4=P,X'p+P Xp where P,=0 if r, is exit . (18) 
However, when r, is regular 
i . 
LAX yS È (Zi 一 门 ) 记 十 2 <o 
j ra 一 站 j<0 j>0 


Similarly when r, is regular 
VX < 
j 
Therefore we always have 
> <% (19) 


Furthermore, it follows from Lemma 4.1 that 
[x°, X" — XA) 0 AL (A), X°] {0 (410) (20) 


If W(A) has the representation (5.10.16) (c = 0 and a, =a,), then by (16) and 
(19), imitating Theorem 4.2, we can find that (A) is recurrent and ergodic and, 
furthermore, 


x, = lim Ap, fa) = Se * 


= : (21) 
410 DxaxNe 十 》x(PX， 十 P X?) 
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Suppose that y{2) has the representation (5.10.1), (5.10.4) and (5.10.33) and 
that S'? = $7! = 1. Write 


GA =L =U PAAA AUN 
x 1 
=) (F0 diag = ) (22) 
ie 


where e? are elements of the matrix F — H; — H U, and F(A) = {f(A)} with 


yab 
peay=0 D= a (bea) (23) 
It follows from (20) and $** =0 that 
1—er11 STS (i}0) (24) 
Thus 
FNF (i10) GÀ = 》 F! 
1=0 
and wW(A) can be expressed as 
2 
Wit) = p E XPAG AMA) (25) 
a=1 


where n°(A) = tp) + M®X?(2)u, in which MY” = 0 when r, is exit. 


Because 
= 0 1 
= 26 
( i ,) (26) 


let 4} 0 in (25) so that w(4) is recurrent. As wy{A) is honest, it follows that 
ÀGa là) >, ni{A) =| a= 152 (27) 
j 
Paying attention to (16) and (18)-(19), and letting 240 we obtain 
mT YEN, + MX phi) < oo 
j k 
From (27) lim; jo AGax(4) >, n? = 1. Hence there exists j such that lim, 19 AG alâ); > 0. 
j 
From (25) we have 
lim Ay (1) > x tm iG, Jet >0 
Ajo ajo 


Therefore y(A) is ergodic. We conclude the proof. QED 
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